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ABSTRACT ^ * 

The collection of 17 position papers, submitted by 
coordinators and specialists in vocational education, is the product 
of a national seminar conducted during 1973, the first year pf the^ 
vocational evaluation project. [Vocational evaluation has been 
defined as the process of assessing an individual's physical, mental,, 
and emotional abilities, limitations, and tolerances in order to 
predict his current arid future employment potential and adjustment. 
It is interdisciplinary and invQlves data, from within and outside the 
total rehabilitation team.] A project overview introduces the . * 

articles. Four articles examine the role of the vocational evaluator: 
ideology and self-concept, task analyses, definitions of knowledge 
and skills, and training. Examining the evajLuator's tools, five 
articles explore two evaluation metJiods: w<prk samples and situational 
assessment. Mso discussed are the evaiu^dr as synthesizer and 
building nev^ self-concepts in the client. Four articles on human 
dynamics concentrate on the relationships, of the eval^iator with thfe 
client, the counselor, other professionals, and the facility staff. 
Four articles focus on the delivery system: referral decisions, 
vocational evaluation in various milieus, active client involvement 
in rehabilitation, and the controversy over the vali^ity^ and use of. 
vocational 'evaluation.^ (JB) 
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"For almost half a century, a very large numberz-of inV^.sti- , ' -.^^ ^ 
gators and working prof essionalsftfe^^ype committed a.*great'\deal '^J; , , 
of time and effort to the development of techtiixjiieff^^esignad • . ^ % 
to evaluate and predict work behavior." WALTER S; NEfJ* (l%f)'*\ 

1, Since the term. "Pre-vocational Evaluation" first appeared^ it 'ftas beeh^ • ^ 
Implied that "Evaluation" is a specialized methodology, belonging .to a^partic\ / 
ulaK^oup of "professionals", "Vocational jfevaluation", heir to the mart^lk, ^ . 
has conXyinued ,in the same tradition. Research data has been collected to „ \. 
provide the background for curriculum .development in the training ,of ""prQ- ^ "^'^ 
fessionals". Vocational Evaluation systems haye been designed whicTi/wcmld 

enable the /'professional" evaluator to administer "evaluation" more ef f , 
ciehtly to a larger group of "evaluees". One senses, however, that tfi^. tlm^s 
are exerting a great pressure upoa the field of evaluation. The er-ph^^i?' upo^i / , f 
consumer involvement, the rights of the consumer ^-atld the emphasis upoi) th'^, /; . > 
client *s "signing off" his own remediation plan, illuminate the indicai:ive\ ^ . 
that research in evaluation must be done from the perspective of. the ciient*s.^ 
needs, rather than the needs of the prof essional 'or of the de^iveiry sy6t^tn.\. , 

• *. ** ^ *■ 

2, The time has come for those of us who prof ess . to^ possess these talents. „ ' 
to seriously ask "Where have we come from?", "Where are we now?"J and "Where . ' 
are we going?", • Even the most elementary survey of the field reveals. that ♦ 

ve share little in common among ourselves except vaguely defined terms, and ^ 

a propensity to audaciously involve ourselves in the lives of othet people ^ ^ ' ^ 

who are seeking help. Our literature is full of contradictions,' the turnovex 

in the field appears to be high, arid there is little concrete evidence that 

"Vocational Evaluation" And all of its borrowed methodology is worth the 

number of dollars being spent to purchase our services each year. Yet, the ^ 

literature abounds with comments on the effectiveness of the evaluation 

process, and existentially you know, that for many individuals, it has 

been a significant turning point in their lifers journey. The time has come 

for us to articulate the present evolutionary development of our field, . . 

and to create a vision of its increased effectiveness in the future,' * ' 

I. SIGNIFICANT "EVALUATION" BENCHMARKS ^ . 

3, Evaluation, systems were created when it became obvious that psychometric 
and paper and pencil testing were not adiequate' f or a portion of the population. 
Experimental sampling of jobs began on a somewhat organized basis following 
World War I, as noted in Bregman (1967), »but the benchmark of ^vocational 
evaluation systeiSis was the TOWER, developed by the Institute for the Crippled 
and Disabled in New York* City in the late 1950*8, It was the first systematic, 
individuaXized approach to vocational 'feyaluation to be recognized across the 
country. As people came to see and l^rn about the system, there proliferated 
.around the country a multitude of quasi-TOWER systems most of which did not 
have either the sophisticated development or criteria of the TOWER, Because 
these *'do your own thing" systems have a lack of applicability from one center 
to another, there has been an obvious need for new systems, more universal 

in nature. The Philadelphia Jewish Employment and Vocational Servieed (JEVS) 
System, developed under contract with the Department of Labor was a serious 
attempt to create a comprehensive evaluation system which was applicable 
in a wide number of communities. Industry has also joined the task, (The 
Singer/Graflex Company' created its own "package" system.) . " 

7 ' I , ' * * ' 

4, The availability of data is as important asi its original creation, Distri- 
^•^ion and resource centers, are key factors,- "Work Evalua tion in Rehab ilitati^^^^ 



/(an educational guide "(ieveloped from an institute held^ in July 1969 in Denver, ColoO 
-wa-s probai)!^ the first sij^nif ic^n^tly recQgnizedJand' acce^t^d book in the field,^ althpugh 
verfually half . of t|ie writib^^ regalrding vacatibnaP^e^lyat^pii to date was done before 

^ts publication* ^ tri^many resf>ects, \hl^^ book*syntfie|iz^s-,ffitiqh^of the earlier, writing 

' had gave the f iei^^.such ^gifts ak .Nef f '^^("1966 196&y cate^or,fes of evaluation' (which\ 
today has wide ackeptanc,ei. 'It^is signi&l,'cant' that. t:4ie \tna"ss distribution and. 

^ reprin^ting df:;thjLs bopk .by^tW Materials Develapment Center'\C?f)C) ajt the University , 

*^Qf Wisconsin---S.t:oijt J coiitributed j^re^tly tp lt{s 'aQceptiiix^e. ¥h^ publicafioripf Work \ 
Evaiuation~An\Ahtfotated' Bibliogfaptiy 1947 Iq also issued 'by MDC> wa3 the vehicle . 

whl^lV allowed/ the fife^ld' to appropriate the pteviqus^ wtiting. J Significant ih^^the' 

'\deveIo>nient and" distribution 'o|, jiiaterial for tlie. fielcl* h^as >e^n't^e VEWAA Bulletin . . 
fikny oth^ public^tions/Kave alW ca'rri^ed articled .on .e^?'a^^at^o^^^nciuding the Journal 
of Rehabilitation , Archives of Physical ,>Iedicine and: Rehabilit,ati6n / The American > 

• Journal of Oecupational Thetapy> : . ' - • ^- . " - ^v: '\ ^ ^ 

,5V ^ ReseajrcH in the field of evaluatsjioh .has beph continiially necessary" fqr the 
creation of *tjj^e^ many programs offered tqd^y, but that research dat|L has^not always^: 

•been formally recorded. Basically, iher^e are two t>^es of Research which ^have gone 
on iti. evaluation,' 1) that, necess^ary 'for'ihe Hevelopment of samples and systems and 
2)' that n^^ssary tV ^et an understanding <)f the * practice *of vo^tloRel evaluation 

* itself^; r^german's (1969) repor^t 'on the Johnstown R ^ I Center 's^tudy, made in. 1966 
^pyovided' 'the, f iiy^t general picturje of. evaluators around.' the count^y^. This was sub- * 
se'q^ntly 'f cUowedJiip by S'ankowsky\(1969) whofee two studies in 19158. and 1969* drew , 
theiir information f^'om rehabilitation facilities (for. the first 'study) and £roto .the«\. ^ 
membership of the Vocational Evaluation .and Vork Adjustment Association (for. the- ^ 

'sec*on4) /'*'jhe '"Think TanV^^ at Stout State ^Jniversity. in 1968 was also'a significant * 
attempt to draw together nati<5nal attitudes from* individuals well rebognized in the 
•field. \ ^^>^,\ V.^ V. ' • '\ ^ \. '\ ' ^ . 

^^6.' Trainiiig in, the fiel^L. of Vocational EvaluatiW has l^t^n, f or ^ost people.^ a 
period of appr^ticeship* Tb4 first .nationally of fefed training in '.evaluation was-. " 
a series, of clasS^s held at the .Institute for the Crippled and Disabled (ICD) -in.;, 

,New Yptk City to teach the^use. of the TOWE]^ System,' and tRe ^develbpment of work sam-.. 
.ples.^' ln\the late I960' s *StQut S,tate" University, University qC ArizonaV afjd Auburn *' 

nU^iversity begkn to oJj^er^ mas£ers/degree^trainiri^ in the field" of Evaluation, •"anfi ' 
shortly' there.after a number ^qf universities began to otfer short-term training *ses- 
sidns .of . one ta foUr weeks oii the subject, Xoday an evaluator may choose from a 
jaiimber-^^of uniyefsity i^ro^rams^^^s' well as specialised trainit^g ptograiSs, such as: 
ICD (the JOWER) ; the Philadelphia. JEVS, or any number of nationally r^^ogjiized' / 
rehaMlitatioii facil4:tlesv' / \ . \ \ o-* 

.* ' "^11. 'A' FERSOIIAL ANALYSIS • . ' • 

7. The necessities 1) of 'understanding your clients. .and, helping t^em to, create 
yocatl^onal and personal ^ goals 2). of beipg recognized as a professional facility by" 
other educa^tional^ rehabilitation, and .manpower programs; and 3)' of paying the bills 
^(evaluation is a service for'which funds are available), have influenced many faci].- 
ities,to* provide evaluation^ Frequently, it is an a'dministrative decision tq offei^ 
the service, and therefore systems are* frec^uently developed which meet th6 needs of 
\the organization rather than being designed" to mee^t the needs ofi.the client ^ Fre- 
quently also is the decision to^o.x^th the ''least expensive syst.em". How can' we 
fconsense upon* terminologies fpr this field,, when each. program is uniquely defined 
hy the attitudes regarding its importanQe and its relationship to other programs, 
in a given facility, a$ held by the administrator,, the supervisors, • and the other 
staff? . : ^ ' . : , .-V' ' ^ ' ' ^ 

. • ' • * >' 
8j ^Research likewise has been -done Out ofxthe needs of .the organization — the 
naed for the development of an acceptahle prog^s^, the need for a professional 




status for practitioners, etc.)* It. has been largely university based and has 
inv61ve4 ,only a limited nulhber^pf practitioWrs. 

9. By and large most practlelng evaluators do not write. Ther^are sevei^al 
reasons which might be givfeK for this: Their inexperience, the fact that they 
have not tead very widely in the fl^ld, the time pressures of their- job, of per-* 
haps, the coi^stant need to write evaluations and other repotts. These factdr,s leave 
many evaluators less ^han Enthusiastic fpr any other writing^. What ever the reason, 
most writing is done by administrators who give geheral background and ]aistory of 
their own programs, by university professors who are trying to get at. the fundamental 
tlxeory behin^f the delivery of evaluation services,, apd by project, directors who are 
wr.iting. up the results of' their research or demonstiTation projects. There is nothing, 
wrong with what ig beings written, itt^:^s necessary. However, there is a Vide gap left 
for practitibners to fill with practical help to their colle.agues in the field. - 
Ther;e has -also be^n little writing comparing vocatignal evaluatioxi with othei^ fields 
of endeavor ~ medicine, social science, e.tc. . • 

IQy' Much has "been .done, however, mor^e than most evaluators are willing to en- 
counter. A frequent comment from practicing evaluators is "there really hasn*t 
been much written about vocational evaluation" or "I want something practical, all 
that theory stuff is over my head". The evaluator who believes there has been^Jittle 
.wribten has not looked, and , the evaluator who refuses to deal with the theory has not 
acknowledged his responsibility to himself, his cl^^ents, and the field. Frequently, 
the evaluator relies on the excuse that he is already overworked, ^nd, therefore, has 
.no time to read. In addition, most facilities pay littlfe attention, to in-service 
training for their evaluators. - ^ 

" ' > .III. THEORY AND PRACTICE . 

' » ' ' ' * 

11. Anyone who diagnosis and prescribes j>rograms *of change for lndivi<iuals should 

b^ well trained, yet,^ in~ practice, many evaluators are young, inexperienced, and learn 
to.be ^valjiators by experimenting with'clients. An evaluator should be knowledgeable 
'about learning 'theory, available training ^opportunities for clients, and should kiiow 
the job market in order to enable the client and his counselor to make realistic 
dec:^sions regarding future work. Conversely, many evaluators have neither worked at 
-a /iill-^ti-os^ job before becoming an evaluator, nor conscientiously researched, their 
local job marketv. An evaluator .should be able to be empathic with the client, to en- 
tourage his best work, to be the client's advocate, and yet be objective. A Clumber of 
•evaluators J however, are So objective that they are merely impersonal recorders 6i 
l^nf ormation, and others become so personally involved with their clients that they 
lose their objectivity. 

12. In order to be affective, an ^evaluator must have good, applicable tools' which 
are comprehensive and which allow the client to probe into his own heeds and abilities. 
Many systems, however, are designed to evaluate the urban male in a* limited number 
of occupational cluster's which fall primarily to lower skill and lower economic^ 
categories. The evaluator has to depend primarily upon his own personally developed 
skills and abilities to inspire his client to put forth his best efforts, and upon 
his personal skills to be able to comprehend and .interpret data from man^ contrib- 
uting sources including the client, other agencies, and professionals who have sdtight 
to help the client. 

13. • It would seen; that to do, his best job, an evaluator would need to have a good 
rapport with his clients, but frequently they become merely numbers or are asso^ 
ciated with classic cases in the evaluators qwn history ("HE*s just like old. .")". 
An evaluatpr should be able to communicate well with other professionals, and have 
the confidence of, arid in, other members of the staff within the facility in which he 

J. ".frequently, he gets little cooperation from other professionals and frightens 



other members, of the facility" staff because of his constant qyestions-^ or their fear 
th^t' -"telling It like it is", will hurt the client. ' . 



.14-. Evaluation should be a part of every "client *8 rehabilitation plan, that is 
not to say that every client should participate in a formal vocational evaluation 
program, hut tliat evaluation should take place. Frequently, however, little evalu- 
ation t)f the client's previous histoiry is considered in the writing of 'the vocational 
and remediation plans and, very often, it is only after other systems have failed that 
the clieHt is sent to be "evaluated'! as'a' "court of^ last resort". 



IV. THE VOCATIONAL EVALUATION PROJECT ' 

15. The Vocational Evaluation Project w^s an attempt to pull together the wisdom 
of knowledgeable administrators, university per9onnel who. have done theoretical 
probing and writing in the field heretofore, and the practical "grassroots" exper- 
ience of over 1,000, people involved in the Vocational Evaluation ^process throughout 
the United States. Participating forums span, the continent from Boston to San 
Francisco, from New Orleans to Duluth.. Thdre were 6 local. discussion forum^ spread 
throughout 30 states. • 

16. Seventeen "Coordinators" created prosit ion papers on 16 delimitate^ topics 
regarding vocational evaluation.. Each forum read one of these papers and 
reacted to it in light of its own {)ersbnal experiences. At the same time, each, 
individual sent information to the project, via .three short questionnnaires, .which 
related to his own 'personal experience. At a spcbnd session, forums brainstormed 

. and organized into a tentative writing outline. 

' *» " * 

17; Each coordinator received the writing outline from the three or iEour forums 
(which were assigned to' discuss his paper). He responded to their outlines and \ ^ 

-sent questions back to each forum for further work and clarification. The forums , 
then re-worked their outlines and corpoi;ately wrote a short .statement regarding 

±beir agreement and disagreement in relation to their topic. < * , 

J>8. All of the statements were collected and duplicated for the first national ^ 
seminar in Atlanta, Georgia. Research 'data including *the §tatements, .the writing 
^outlines, the 17 original position papers, and results of the questionnaires were 
the spring board that conference. At that titne", pa^^ticipants made up of the ' 
17 coordinators anS ;17 forum leaders f tom participating forums corporately wrot^ 
a prelimanary statement on the state of the art of vocational evaluatlon~1973.* 

18. Halinos (1970) points to "sbdio logical inquiry and communication thems-elves 
as major social actions and interventions". Th^ vocational evaluation project 
in its first year has had an impact upon the f i,eld of evaluation. It has l?een the 
^catalyst for discussion and idea sharing between professionals in vocational reha?- 
bilitation, special education, and vocational education. ^ ' 

'20. The wotk of the first year, and the articles which follow in this book, repre- 
sent signif^icant opinions regarding vocational education in 1973. The autlfots 
wfere chosen because of their first-ha^d knowledge ^ of the field. They were orig- 
inally' published as individual papers for the use of the individual local forums, 
but are reprinted here as a group because of their value as a comprehensive state- 
ment on vocati^al evaluation, in 1973. While they stand on their own, they also 
represent the first step toward a common understanding of the ideology of voca- 

tioxial evaluation. ' » " , 

« 

Stanley H. Crow 



{SELF STORY (Concept) 5; 

1. A crucial element in the occupational identity of 'the vocational evaluator, is 
the self story (concept) which the evaluator has of himself and his craft. The 
occupational ideology of vocational evaluation (as within any occupation) ;ls signifi- 
cant in determining its public acceptance, continued viability, and growth or decline - 
as a vocationally unique specialty. In addition to mediating the internal operations 
and functioning of vocational evaluation, this occupational ideology influences the 
conceptions that other occupations and professions, the clientele served, and the 
general public have of evaluation. To some extent all occupational ideologies contain 
eldments of fact, fallacy, and stereotyped thinking or mythology which contribute to 
the total* cone e^i^tualizat ion of that field. A thorough examination of the ideology > 

and self concept of the vocational evaluatjor, is an essential ingredient in understanding 
the occupational and social ^organization which characterizes the field as a whole. 

2. The se'lf concept of the evaluator,* as viewed from the analytical framework of 
sociological study can be characterized with'in the following 'dimensions: 1) Paro- 
chialism-ecumenisTrt - a parochial ideology and self concept is seldom diffused to 
other occupations, while. an ecumenic one is disseminated among multiple occupations 
and to the occupational world in general; 2) Stratification - occupations character- 
ized as being" professional ^have more complete and well articulated ideologies and - 
self concepts, while those which are not professional and are serai-professional have 
a less completely defined sense of occupd^tlonal identity; 3) Boundary maintenance - 
occupational ideology may contribute to a rigid definition of who. is an occupational 
practitioner and what his tompetencies are, or to a more diffuse relationship which 
allows far less exclusive practice: 4) Indeterminate-determinate - an indeterminate 
self concept is characterized by few qualifications for occupatiotial entry and minijuum 
directives for guiding the worker in the specific details of his job, while a deter- 
minate, one is characterized by more elaborate entry prqscriptlon^ and minutely determined 
rights^ duties, and norms; 5) Stereotype -.the occupational stereotypes suggested by 
self concept will determine training, ^remuneration, mobility, and occupational prestige; 
both the general public as well as the practitioner may be influenced by these occu- 
pational stereotypes and role expectations; 6) Special ideologies - self concept may 

be influenced by perceptions along the dichotomous distinctions of white-collar/blue- 
collar;^ helping/service, science/art; etc. These dlmension;5 should be kept in mind 
when reviewing the historical development of the field. The^ basic framework of this 
pap^r on the vocational evaluator and vocational evaluation, is 5?hat of vocational 
evaluation as an "emerging profession". Currently, * vocational ^evaluatrion may be 
considered as 'a semi-prof ission, which denotes that it does not. rest upon a firm 
body of theoretical knowledge, has,^relat;ively short training period, and cannot 
claim a monopoly of exclusive skills. The semi-professional self concept of the 
vocational evaluator, who is striving for professional statij^s, will be examined to 

determine the unique* subculture (mores, roles, norms, folkways)' of the field. 

; ' . . » i * * 

REVIEW OF THE lITERATURE 

3. The early organizational attempts and literature of a semi-profession 

for professional status,^ largely concerned with the" delineation of a unique occu- 
pational role and a rationale for existence. Much of the early and even current 
'literature within vocational evaluation is directed to this- end. One of the earliest 
written rationales* for vjocationai evaluation is that of Frederick A. Whitehouse 
(VJhitehouse, 1953); tljis article discusses the limitatians of standard tests, and 
suggests the contribution of the Institute for the Crippled and Disabled Guidance 
Test^ Clashes., Th6 vocational evaluatCrj as described, is a joB sample administrator 
and provides a specialized and valid source of vocational information to the inter-. 



6. 



disciplinary rehabilitation team (training instructor, vocational counselor, psy- 
'chologist, physician). Thus, Whitehouse presents and defines the concept of a 
"living period" evaluation, specifies how it is distinct from other sources and 
client information, outlines the role of the evaluator and his* unique contribution 
t^o information needed by other rehabilitation professionals. This rationale repre- 
sents an early effort to create a parochial image for the vocational evaluator as a 
distinct member of the rehabilitation team. It was parochial not only in** being 
limited to the field of vocational rehabilitation, but also because it arose from 
a specific rehabilitation agency program and would conceivable only be translated 
^ into the program of other, rehabilitation agencies. 

4. Several years later, Redkey and White presented a detailM and comprehensive 
program plan for the d^elopment, organization, and operation of a prototype vocational 
.evaluation unit. This provided governmental sanction for vocational evaluation activi- 

, ties within public rehabilftation centers mandated by Jhe Vocational Rehabilitation 
Amendments Act and Medical Facilities Survey and Construction Act of 1954. As defined 
by tlje monograph, pre-vocational activities are of ""a specific naturg and "directed 
tpward an evaluation of .the patients* vocational potentialities" by means of a 
"realistic appr'aisal of [individual] capacities and abilities". This definition 
describes a distinct unit or organizational structure within the medically oriented 
rehabilitation center, which provides tri^l work experiences for clients. The speciali- 
zation and differentiation of the pre-vocational unit, and the role of the "pre-voca- 
tional supervisor", were easily translatable to a much larger class of rehabilitation 
facilities than that of Whitehouse' s. Furthermore, an organizing structure is the 
same organizational level as P.T., O.T., psychology, social work, and similar depart- 
ments in centers.. The equipment, staffing, record keeping, floor plans, etc. of 'the 
pre-yocational unit are described with great detail and specificity. The pre-vocational 
unit supervisor, as described, is required to have diagnostic and evaluative abilities 
which are not possessed by other rehabilitation professionals. These abilities are 
not described in detail, but are precursors of later and more detailed and precise 
definitions of the competencies and responsibilities of the vocational evaluator. * In 
contrast to vcJcational' evaluation as a distinct one time process performed by a distinct 
unit within a center, the private sector rehabilitation program perceived vocational 
evaluation quite differently. As described in a widely disseminated publication 
XThompson, 1958) "-evaluation is a continuous, not a static service". This concept is 
further reinforced as follows: "Although much specialized diagnosis and evaluation 
may precede admission to the workshop, continued diagnosis and evaluation are necessi- 
tated.... Compairtmentalized diagnosis and evaluation completed under laboratory 
conditions of a specialjjsed nature sometimes differ from those of a real work situ-y . 
at ion. .. .Evaluation should continue under the work situation." Thus,. quite early \ 
in the history of the vocational evaluation movement, differing conceptions of the 
vocational evaluation process as* influenced by differing bureaucratic structures 
(the publicly supported rehabilitation center and the private r^ehabilitat^on worksjiop) 
presents itself. The influence of bureaucratic factors upon the conceptualization of 
vocational evaluation, and the evaluator, are still with us tojlay. 

5. In 1960, some 6^years of experience in vocational evaluation was summarized^ by 
the loVa Conference on Pre-Vocational Activities (Muthard, 1960) whici] clearly stated 
the nature of vocational evaluation at that time*. The pre-vocational unit in differ- 
ing organizational structures was discussed in relation .to staff and methodology.. In 
addition, program descriptions for the rehabilitation facilities, which had pioneered 

in pre-vocational activities, were provided , at this conference. This provided visibility 
and legitimation for the general adoption of vocational evaluation as a distinct service 
. category. A number of key questions were confronted in small group discussions which 
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produced a more refined definition and rationale for pre-vocational activities as a 
counseling adjunct in guidance and selection. General comments were generated 
regarding t\ie client for evaluation, the characteristics of a good pre-vocational 
evaluation system and appropriate research questions. Although the "pre-vocational 
evaluator" is not discussed in detail, in his address to the conference, Marfin Moed 
of LCD. discussed the varying backgrounds of evaluators and suggested the evaluator 
as needing a composite interdisciplinary training or education. This is one of the 
earliest attempts at stratification and .the establishment of boundary maintenance 
for voca^tional evaluation. During the next 5 years, a number of articles relating 
to vocational 'evaluation appeared in various rehabilitation and related journals which 
furtlier refined its application to a variety of client disability groups and to dis- 
parate organizational settVn^s. Finally, in 1966, the Vocational Rehabilitation Admin- 
istration issued a publication, concerning goals, methods, techniques, and ^processes in 
an effort to resolve the "considerable confusion and discrepancy currently existing 
between [vocational evaluation] units." (Little, 1966); the document is desl^ned^as ^ 
an "operating guideline" for vocational evaluation units, and provides well defined 
operational goals and standards, which aire proscriptive in nature. In the matter of 
personnel, the responsibilities, training, and experiential background of the rehabili- 
tation team .are discussed in detail and, it is noted that, there is no recognized train- 
ing requif^ilfents for vocational evaluators. 

6. Eventually, a Vocational Evaluation Gyaduat^e Curriculum was developed at ^ Stout 
State University (P. Hoffman, 1967) to fill the increasingly expressed needs for 
specialized training in -vocational evaluation^ This effort has not only led to the 
jpromulgation of several other university programs, tut it has legitimated the need 
for specialized training (an aspect of boundary main^tenance) in vocational eyaluation, 
and to the collection and dissemination of a more succinct knowledge base. At about 
the same time, a iiation^l organization of vocational evaluators was developing which 

is now knoxm as the Vocational Evaluation "and Work^Adjustment Association (V.E.W.A.A.) . 
The formation of this proffessional organization, and the development of a professional 
code of -ethics, and the values of a service orientation, {V.E.W.A.A. Bulletin, '1971) 
indicates further steps in the prof essionalization process. Recent efforts to more 
•finely define the identity, duties, role (and consequa?itly the self concept of the 
vocational evaluator) have been generated at a speedy pace (Pruitt and Pacinelli, 1969; . 
Hoffman, 1969; Journal of Rehabilitation , 1970; Pacinelli, 1970; IRS Conference, 1972). 
Furthermore, there have recently been ecumenic suggestions that vocational evaluation 
is widely applicable in educational, social welfare, and other service settings. The 
efforts detailed above have culminated in the V.E.W.A.A. Special Project Forums in 
1973-1974, which are clearly designed to refine the identity and ideology of vocational 
evaluation and the vocational evaluator. 

'personmTob servations . ^ 

7. Much of the equivocation currently experienced in vocatignal evaluation, and the 
attendant crisis of identity experienced by the vocational evaluator, is the result 
of the prof essionalization process itself. Early efforts in vocational evaluation 
concentrated upon differentiating the vocational evaluator as a succinct and dis- 
tinctive member of the^rehatilitation team. No problem was encountered in locating 

a suitable clientele for vocational evaluation, since vocational evaluation adopted 
the traditional rehabilitation client already served by rehabilitation agencies.' 
The true challeng^^ of the emerging field has been the definition of a unqiue and 
systematic body of knowledge which is differentiated from other professions. Although 
this process contiiniies today, vocational evaluation is still experiencing thfe pro- 
fessional marginaiity of a semi-profession in transition, '^is is true,. since there 
continues to be a lack of congruence between the occupational ideology expressed by ^ 
the literature. of the field and the actual role of the practitioner evaluator. A 
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^discrepancy exists between ^the image and the reality in vocational ^valuation for a 
number of reasons. This marginality is comparable to that of t*e immigrant who is 
on the periphery of two cultures, and who' has the norms and values of his old cultures 
as well as that of his new Culture,. ^ For the vocati6nal evaluator, the dontradictions 
or inconsistencies of onj^,partial prof essionalization produces., conflict ing expec- 
tations and occupational uncertainties. ' , ' ^ * * • 

8. In the first place, these uncertain^es arise because, of the non-homogeneity of .v 
practitioner evaluators,. Few evaluators liave the specialized formal training or 
experience baSe that would appear' to be prerequisite for the professional vocational 
evaluator. Furthermore vocational evaluatcirs function in disparate employment situ- 
ations which do not easily fit the generalities and generalizations suggested in\he ' 
literature: The currently practicing vocational ^valuator h^s had his academic train- 
ing in a diversity of 6ther fields, and his ideological allegiances and identity often 
defer to his background in industrial education, psychology.,, counseling, etc. The 
non-homogeneity which i? characteristic of the field makes the process of occupational, 
socialization all tl^e more difficult, and is pne reason for the lack of identity and 

a contradictory self concept. Since a large percentage of practitioners-ate not 
V.E.W.A.A. membets, the social mechanism of collegial evaldation ajid apprpval does 
not effectively operate to cpntrol entry, i:ewards, and advancement in the field. 

9. Another significant reason for anomie within vocational evaluation is tH^ lack 

of ptofessional autonomy due to the superoirdinate control of the employing rehabilita- 
tion agency. Self control, with regard to' the development and application of a body 
of knowledge-,^ is essential to* the development of a professional knowledge base, ^.p- 
ically, the evaluator is subordinated to the goals, procedures, and structures of the 
^ agency that employs him. External bureaucratic control, produces thejLdentity strains 
evidenced when the evaluator is confronted by an inconsistant, internal' framework. An 
occupational ideology has been advanced ty, ^'career activists" in an effort to br'ing 
about occupational change, and this ideology often runs counter to organizational 
ideology. Vocational evaluation is heternoraous to the extent that it is guided not 
only by professional norms, expert knowlege, and Its own professional commu^iity, but 
also by the administrative rules of- an organizational hierarchy. As has been suggested,- 
the. organizational requirements of pubUcly-sup^ported rehabilitation centers differ 
from those of privately-^upported rehabilitation facilities, creating a dichotomous ' 
conception of vocational evaluation. This situation reflects a further source of 
ideological inconsistency and incongruence effecting the self concept of the voca- 
tional evaluator. • ' • 

10. A further contributor to the incopgruent ideology in vocational evaluation is 

the often diffug"e relationship between the~ evaluator and evaluee* Vocational evaluators 
too often are not really, specialists, ancf ^re expected to deal with a large number" and* 
diversity of client types and client problems. This lack. ol specialization contributes 
to an incomplete occupational ideology and uncomf ortableness on £he part of the» 
evaluator as unrealistic demands are rafde upon him. ,.Jh6^ evaluator often feels inadequate 
in coping with the unrealistic and uniformed demands of his employing agency and other * 
professionals, and the challenge of having the^ H^ical answer for every unanswered 
' client characteristic or problem area. Unreatlistic expectation^ are likely to have ^ 
resulted from the exaggerated expertise ^^anced by "career activists" in ideological 
propogation* The true capacities, expefiencej ^nd education of the practicing evaluator 
often falls short of the adv^tiged expertise of the field, and' thus may creat^e impossible 
perfon^nce expectations.- yj^ ' ' ' . 

/ " ^ , ' / 
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■-^ THE QUESTION OF THEORY" 

3,1. The complete development 6i any profession in transition relies upon ideological 
texts, theories, doctrines, or concepts which are proposed by the interest group 
.(the proponent) to influence and direct the 'behavior or actions of a target group or 
groups. . fhe target group may be the rank and file member, other professionals, govern- 
ment, the clientele, or the general public; it is j^a this mechanisfc^^hat the semi- 
profession can completely professionalize and advame its Inf^&nceupon others. This 
mechanism, of course, is multi-pprpose and mu 1 1 i- tar g e t ed *jWBHir^^^8 ^ function' 
over time, lose relevance^, be superseded, and finally be rHflpfp by a new ideology 
having differing inter-group ends'. Most vr iters agree tha^xhecore characteristics, 
distinguishing a professl^pn from other occupations, -are these: a basic body of theo- 
cal knowledge (the knowledge base), a ccfemand of special skills and competencies 
Ste- applipatlpn of this knowledge, and guidance by a code of ethics which focuses 



service to the client. Vocati«Qnal evapiation has been classified as a semi-pro- 
fession in this paper, since several of thefee qualitites are not as yet fully developed. 

^ l2. There is^no systematic knowledge .bas.e< now; only a short; period of special- 
t ized education and training (if any) is required to practice as a vocational evaluator. 
The early trend in vocational evaluation has consisted of emphasis upon method, tecla- 
niques, organizational principles, and •occupational distinctiveness, while little effort 
has been ma3e to develop the systematic knowledge base and theory required of a pro- 
. fession. There has been, of course, some notable exceptions, including Neff , Nadolsky 

Barad, and others, but^ nevertheless, this codification still alludes the field. Emphasis 
- upon method and techniques should continue, however, if not reinforced by a theoretical 
fxamewark, the viability and progress of^ vocational evaluation w^.11 suffer. It should 
be noted that the definition of vocational evaluation has gradually evolved from lega^l/ 
administrative and descriptive definitions to functional or operational definitions. 
This rrfinement is essential if the field is to develop testable and researchable 
questions, which will contribute to theoretical analysis and theory building. 

13. .The Co'de of Ethics, advanced by V.E.W.A.A in 1970, reflects an' incompletely de- 
veloped teiowl'edge base through its Vague gej^aMzaftions. Even JLf he is aware of them, 
it 'is- difficult for the individual practitJRr to concretize the concepts contained 

in this document. Although this Code of Ethics is an attempt to indicate a professional 
community^of vocational 'evaluator s, it is difficult to interpret and enforce the code. 
The practicality of any ,code of ethics relies upon tKe self control, social education, 
^Vi\ public recognition of a strong and influential professional association. This can 
be Reinforced by widely dispersed and active majority membership of practitioners, 
licensure or certification requirements, widely recognized and accepted educational 
requirements^ and the resolution of conflicting elements. It is clear that the 
develo^ent of the current Code of Ethics is premature, since this code does not in 
any way limit entry, interrill composition, a^d unscrupulous or unprofessional behavior 

. and practices*.. That is> the professional norms suggested by this Code are uninfofcer 
'afcle. furthermore, ,it is interesting to note that although the code indicates that 

^"primary responsibility is to the client"; bureaucratfc resportsibililty to the 
philosophies, goals and, practices of the. employing agency is also stressed. 

14. The ideal of service to the client group,, and to professional authority, in -con- , 
trast to bureaucratic authority, 'is strongly felt by a large body of vocational ' • \ 
.evaluators. However, there is no monopoly o'vler special competencies which are 
regulated by licensure or certification, or even a legal basis for privileged 

' communication* with clients. Since, by its^ namire, bureaucratic control consists of 
' a univer^alistip^ set of rules and generalized procedures, there is an inconsistency 
with the professional rehabilitation goals of vocational evaluation which are 
Individualized and particularized. ^Tiie only taeans that the vocational evaluator 
to 'strengthen and reinfo^:ce his, Sources of professional identification are 
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through professional organizations, which will provide the /'rites of intensification", 
to enable the nurturance aud development of his. identity and of hiOy^craft^ 

CRITICAL DEFI^IONAL gUEgTIONS ^ ' 

15. The basic framework of this papei: l^s rested upon the assumption ^that the self 
concept of the evaluator has largely been opt ermined^by the nature of the .process of 
prof essionalizat ion. The most widely accepted conception of the vocational evaluator, 
as he Is viewed today, is that of a technician-lmplemeijter . ! ^n contrast i several 
"career activist" vocational evalua*tors, acting aS spokesmen for the' field, have.sug- . 
gested the more prpf essionalized concept of the expert vocational evaluation practitioner. 
The fact of prof essionalization has no valence (either as a positive or negative force), 
€ince it is viewed here as a natural process, which each occupation must deal with some 
time. It is a fact of life from which further assumptions must and should be made. 

16. What then are the issues whicrf must be dealt with to. further define and describe 
the self story (concept) of vocational evaluation? First, there is the question of 
the knowledge base and its continued .refinement and development. Related to this is 
the dicl^otomolis and contradictory ideology ar^-sing from practices in centers, versus 
those in facilities, and whether this dichotomy will hamper the development of the 
field. Should. the focup on^practical knowledge be continued or should the emphasis 
shift to academic the^etical concerns Xoi^ perhaps a division of labor whete both 
are accomplished) ?J^erhaps the establishment of the private vocational evaluation 
practitioner qj^^^^sultant will facilitate t^he development of this ^ knowledge base. 
Are there any alternatives to the establishment of this knowledge base? With regards- 
to the dissemination of the field, questions must be asked of thfe' parochial-ecumenic 
nature of the field, stratification, boundary differentiation and maintenance, the 
determinateness-indetermdnatenessof the field, and alteration or acceptance of 
internal arid external stereotypes. , * . 

17. With regards to the specialization af the field^ questions must be asked with 
Regards to buifeaucratic versusS^rof essionalTcontrol within the occupation, and ways in 
which this issue can be dealt i^th. Organizations which eitfploy the semi-professional 
are typically authoritarian jLn administrative style, and considerable compliance is' 
required. Unlike more securely established professions where the practitioner is 
esteemed and rewarded, the^ evaluator must nprmally become a supervisor or administrator, 
to be successful ^nd influential in these organizations. The tutnover of rehab'ilita|:ion 
personnel reinforces this lack of authority and prestigfe, since collegial solidarity 

is fragmented and hampered by rapid entry and egress from the j^ield, Q^ccupatiofjs 
which seek professional status must engage in transactions concerning prestige, power, 
and money with t"he society at large and this involves public dissemination of the 
occupational ideology. This issue must be addressed and dealt with prior to full 
•development. 

18. Finally, the issue of our professional organization, V.E.W.A.A., must be dealt 
with in a meaningful manner. That is, if an aggregate effort to contribute to the 
process of" forming an occupational ideology and true profession is necessary, how is 
this to be best accomplished? The acquisition of a theoretical and occupational 
specialization for vocational evaluation will, in the end result, contribute to the 
economic advantage of the profession itself; bit, by. raising require^nents for the 
competence of entrants, establishing control over the ethics and qualitative perfor-^ . 
luaace of practitioners, and Improving tf^chniques in providing service, society as a 
whole will benefit. Given an ideal of service derived from the mother field of 
vocational rehabilitation, the resolution jof these issues seems essential to the 
dalivery of promised services. ' ' ' * 
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19, The key questions vhich should be confronted by the field in light of the analysis 
presented above, are ^s follows: 1) What is the best means ly which a sufficient 
knowledge basB can be established along with continuing practical support for the 
practitioner? 2) Need there be a resolution of ideological inconsistencies between 
the literature and actual practice, in the field? How is this best to be accomplished? 
3) Are separate. models for vocational evaluation in the public sector necessary to 
clearly differentiate them from* the private sector? 4). What is the best means to deal 
with the issue to bureaucratic versus professional or collegial control in the practice 
of vocatioi^l evaluation? 5) If deemed appropriate, what steps are necessary to 
increase the support and acceptance of V,E..W,A.A. by practicing evaluators, the general 
public, the client groups, government, and other professionals? Should vocational 
evaluation stress parochial or ecumenic accerptance of the vf ield? 6) Should V.E.W.A.A, 
attempt to enforce more restrictive entry,' stringent rules of practice, and educational 
criteria- for practice as a vocational evaluator? 7) Finally, will the process of 
forming a "grassroots forum" contribute to the occupational identity ,of\the forum 
members and what will initiate or sustain this more complete self concept?' 

20* Additionally,, there should be a number of questions which arise from the discussion 
of, this paper. Feel free to challenge any of the concepts, comments, or opinions ex- 
pressed in the body of the document, and suggest alternate rationales or conceptuali- 
zations which arise from this discussion. The issues confronted are of Buch a nature, ^ 
that controversy is to be expected if the topic areas are to be completely explored 
and analyzed- Above all,' this forum topic should be confronted from the ^j^^eage point 
of .evaluator , evaluate thyself ! 
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/ " f THE VOCATIONAL EVALUATOR: A TASK ANALYSIS 

1* According to Hoffman (1972), vocational evaluation is a comprehensive process 
that systematically utilizes work, real or simulated', as the focal point for 
vocational exploration and assessment, the purpose of which is to assist indi- 
.viduals in vocational .development. Vocational evaluation incorporates medical, ^ 
psychological, social, vocational, educational, cultural, and economic data in the 
attainment of* the goals of the evaluation process^ It ,is an asse'ssment process . 
beginning yith a referral for evaluation and en4ing with a recommendation for ^ ' 
further services needed by the individual. Evaluation is goal oriented, with the 
goals being developed from comprehensive referral information^ and awarenq/Js of 
counselor-client ^objectives, 

2, Evaluation, no matter what it is called in the varidus settings ;Ln which it 
is provided, is the key to successful decision making and the identification of 
life goals for* individuals seeking guclt*^rection, . The role of "evaluator," tio 
matter what it is called, is the role of mie who guides individuals through tha 
decision making process by facilitating among many options for living. 'The 
function of vocational evaluation, and the role of vocational evaluator, must be 
identified at least in part in terms of the jobs and tasks he performs. In this* ^ 
regard the U,S, Employment Service defines job analysis as a systematic study of the 
worker in terns of what he does la relation to date,' people and things, the methodo- 
logies and techniques employed, the machines, tools, equipment and work aids used, 
the materials, products, subject matter, or services which result, and the traits 
required of. the worker, A task is defined as one or more ^elements, and is one 

of the distinct activities that constitute logical and necessary steps in the 
performance of work by the worker, A task is creatw^ whenever human effort, 
•physical or mental, is exerted to 'accomplish a specific purpose. 

*'brief review of literature 

3, Pruitt (1972) has done perhaps the most comprehensive review of the literature 
' in regard to task analysis for vocational evaluator s. He has iSentified three 

^ major studies, one by the University of Pittsburgh, R & T Center, 1969, one by* 
Egerman and Gilbert, 1969, and one by Sankovsky, 1971, The Pittsburgh study (1969) 
considered such factors as, the emphasis of the facility, types qf services provided, 
whether the facility was non-profit or governmental, its geographic location, staff- 
ing patterns, number of vocational evaluation staff, educational level of the evalu- 
ators, educational major of 'the evaluator, previous work experience, type of dis- 
abilities served by the facility, length of evaluation period arfd average number of 
clients evaluated within specified time periods, client follow-up, objectives of 
Xhe vocational evaluation program, and average amount of time spent On specified 
vocational functions* Their most significant finding ^was that differences in vo- 
cational evaluation services are a function of the emphasis, location, and staffing 
patterns of the facilities studied. 

4» Egerman and Gilbert (1969) conducted a somewhat Similar study in reviewing the 
variables of education^al background, emplojrment history, work activities, salary, 
job knowledge and satisfaction, profession^ affiliation, and personal characteristics 
of the respondents* Of special relevance were findings pertaining to work activities 
of evaluators, 'The following functions were listed by over 60 percent of the re- 
spondents: Attending and participating in regularly scheduled ^taff meetings and 
staffings. Observing clients at work. Helping clients adjust to work environment. 
Writing periodic reports on client progress. Administering work sample test6, or 

• * 
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performance measures; Developing recommendations for training, placement, etc., 
based in part on test scores; and Teaching clients good work habilts, Evaluators 
were most .knowledgeable in the administration of work sample or work performance 
tests, and in the interpretation of these restilts, ,The three a^as which they 
knew le^st about were the selection," administration, and inter^etation of psycho- 
logical tests.. , . • . , 

5, Sankovsky (1969) studied the patterns of services in vocational evaluation. . , 
fhis\tudy did not consider the percentage* of time that evaluators spend perform-* 
ing the various work evaluation functions. However, it did indica^te the hiftnber^ ^ 
of facilities offering these services, and the time that was spent on several 
functions. The following evaluation approaches that were considered useful were 
^ranked as follows: 

Job sample ^ » ' 26 percent ^ 

Situational Approach \2k percent - e' 

Job Tryout 20 percent 

Psychological Testing 18 percent > 

Job Analysis , . ' 1 percefit ' 

%. Pruitt concludes that there "has be/en a very limited number of research studies - 
dealing wit> tlie rple and functions, of vocational evaluators. 'His stucjy was con- 
ducted tp validate the task analysis- fcw^the job of vocational evaluator and to. 
compare a ^roup of evaluators having master *s deg^e in vocatiotial rehabili- ^ « 
tation with that speciality, with a second group fecking the formal training and 
graduate degree in vocational evaluation. He concluded that seven major functions 
were being carried out, involving 67 major* tasks. He^also concluded that formal^ 
trained mastet*s degree I'evel work evaluators view the relative importance of eyalu- 
ator tasks dif f erently ^from informally trained evaluators working in facilities in 
Wisconsin. These groups were, however, not opposed to each other, but differied in 
degree only. ^ , ' < 

■ PERSONAL OBSERVATIONS . . " 

7. My personal experience with vocationa^L .evaluation has been limited to two 

. settings: a coirprehensive state^rehabilitation center and a youthful offender 
rehabilitation project located in a rural community. In the state center evalu- 
ators had been trained in rehabilitation counseling, vocational instruction, 
clinical psychology, and occupational therapy. Each evaluator learned his job 
on the job. He accomplished his job as he saw fit and used techniques' cind pro- 
cedi/res he felt most comfortable with. In one sense vocatiotial evaluation suffered 
from the ambiguity^ of b^ing rathfer non-standardized and non-bur eaucratized. How- 
ever, that- may also* have been a^ positive virtue. 

8. The youthful offender rehabilitation project operated by Teledyne Economic 
for Los Angeles County employs vocational evaluators with vocational education 
and instructional backgrounds. -This is because the focus of the project is 
oriented toward votational orientation, world.of work exposure, and the selection 
of a skill (cluster) for training:. In other words the nature of the clientele 

. (adjudged offenders aged 16-18 witli frequently associated school drop-out and 
drug problems) and the focus of the project lead to the selection of certain 
types of people as vocational evaluators. 

9. Tliese findings are consistent with those of the researchers reported above. 
It is entirely possible that effectiveness may be more attributable to 'certain 
personal characteristics and genuine feelings of concern,'. (similarly .to the 
Carkhuff studies in regard to counselors) rather than academic training or tasks 
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perfoi^ed per se*\ In tieither of tire instances cited above were philosophical 
assumptions or sophisticated, statistical devices, considered or ^ployed on the 
part of pragmatically, oriented evaluators, 

> ♦ » , • • * 

1(X rt is of interest to note that although these forums are concerned with job 
or* task analysis^ only one per cent of eyaluators in Sankovsky^s study thought 
that job analysis vas- useful in working with individual clients. 

THEORY AS RELATED TO PRACTICE 

IK In performing a task analysis, on the functions of the vocational evaluatpr, 
it is instrucrtiy.e to look at «the context in which he^ works. This •co^t'ext Includes 
the objective of the service, facility,' or adniinistrative entity, 'as well as the « 
objective of 'the particular evaluator or evaluation team, working in conjunction . * . 
with a number of clients. It' also includes the assumption^ underlying data f 
analysis ^nd declsioti. making activities. Finally, it include^ major professional' ' 
implications for the grot^^th of the profession of vocational evaluator itself. In 
terms of agency or_facility objective, the* task of the vocational evaluatoir is ' 
rightfully, (according to currect. legislation) concerned with a vocational objective. 
H9wever, it must .kept in mind tliaty perhaps, over the .long term, we are evaluating 
foi? employability 'rather than for a specific vocational oqtcom^ per s.e . The \ . ♦ 
recently vetb'ed Rehabilitation Act* addressed itself to this issue as well as some/ 
^f th^ currect research on non-vocational outcomes being carried out by Overs at 
^th^^ilwaukee Curative Workshop. . £ ^ c 

12,. The. objective 6f the individual ^evaluator might seem to fall into different 
categories of effort. Is he evafuatijig from a ""personnel", perspective,, or ^rom' a 
'"human development" perspective? Jf, indeed, ^he is evaluating a$«$ personnel mati, 
.he is concerned \^ith the development of selection *^ratios and the 'screenirigt/ 
out of only certain types of 'people. If ^he is concerned with human development, ' © 
he' can take th'e s^e'data and use it foy diagnostic and prescriptive purpposes^* " 

l'3'.j It ,may be ifiportant here also to nate. the difference between selection and; 
classification outcom^^/ Selection policy calls for the, specif ic selection, i.e. ^ 
the' pinpointing of the* best^ man for.g^ specific situation , even if others are by- 
passed, i^^: selection of^Peace Corps volunt?eers^.for specific assignment^. Class- 
ification, Q.n the other hand, calls for' optimal performance^ Therefore, ^f 1,000 
lawyers enlist in the Army and 999 infantrymen are called foi: plus one lawyer, t%en' 
999 lawyers will'^be classified as iilfantrymen . In -other'" words, classif itation ' 
calls for.< optimal ^voup perfornmoe rather than' maximizing individual performance, 
'ft . . * 

14. Finally, ^the is^ue ;of professional implications must be 'addressed.. Is there^ 
or should thare bfe, a/sepdt^atfe discfpline of. vocational eval^iatbr? Are therfe 
advantaged ^ (which* Outweigh t!ie disadvanta'ges) in carr'ying out this function using 
a variety of people with diff erent , professional backgrounds? *Js .the fledgling pro-, 
fession strong, enough to tblerate its, own ambiguity of funqtion^, pr witll^ it suffer 
from a "premature cl'^Sure"" and locking- in. Should* vocatioti^l e'vafuation be "owned" 
by any one discipline? \ " \ * . \ 

. • SEVERAL UNT)ERtYING.OUESTIOi^*'. * 

\ • J . y ■ 

15. The question JO f data collection and analysis if fniportant in tertns of a re- 
ductionistic versus hdlistiij view 'of. the uorl'd. this isdue is both>practipal.' 
and philosophic and concerns the idea of whether the whole is greater than ^e , * 
sum of its parts or whether, by reducing all components to' jot* activities, mpjion 

'studies, etc.*, any kind of accurate pic&ure can be ascertained*.. A subsidiax^ Issue 
involves the notion of statistical versus clinical prediction discussed MeeW 

ifeehl ultimately concluded that neither one was* sufficient tinto it^lf .** 
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but that statistical d^ta were very effective in narrowimg the field of choice 
while ultimately^ no matter how good this data.- was, individti^I decisions h^d to ^ 

be made cXinicariy* (subjectively). He also discussed^ the validating versus the 

structural implications in using statistigal data. He concluded that his statistics 
served an important validating function, but did little to explain underlying causes, 
; i.e.. structural elements. ' . 

16. At least four major questions come to mind. Each of them derive from the 
overlay question?.' as to ^whether a task analysis should be performed at all at this 

. time. ** Task analysis is an, empirical technique which reports what is, rather than 
,wHat should be , or what might be . ^s such, immediate conclusions can too con- 

•veniently beoconverted . tp .curricula' s, operating policies, etc. Question ifli Can 
we withstand this temptation? Furthermore, .my hope is that the results of this,^ 
forum will be seen in context as being only 1/16 of the entire project. Question 
ill: Can we understand^ the results of a task analysis — simularities and differences — 
without maki.ng. premature value judgements or without seeing things^'in context? 

17. A study of this kind ^s.ets, up a model for task analysis of vocational evaluators 
which, in effect, §e-rves as a model for their day-to-day activities. In effect, the 
profession blesses tiiis approach. Important data may be ga.ined using this approach, 
as long as the '^ata, ^conclusions, and interpretations are seen within an ov-erall 
context." Question {13^ Is the profession secure enough to consider more humanistic 
alternatives or 'the possible application of Carkhuf f 's ,f indings in vocational 
evaluation? * - ' * ' ' 

18. Finally, in^ dealing with the real world one is struck with the realization that 
•tftere aje no absolutes - no 100^ correct observations, decisions, actions, or circum- 
stances. At- best, we must keep in mind. that decisions are most often made ,in terms 
of taking thd^^stpption atnong available options i.e. considering available alter- 
native strategies. Question* • Can we consider the result of this task analysis 

"•as tentative and indeed the process itself as tentative in terms of real world 
options? 

"19. My ^CHALLENGE^TO*T^E F0RU>1 at this time is two fold. First, we must individu- 
ally conduct a task analysis of ourselves i.e. our duties, functions, and tasks. With 
this in mind, a copy/ of the official U.S. Department of Labor Job Analysis Schedule 
(0MB A4-R0722) is attached.* The title, vocational evaluator, does not suggest a 
commonality of tasks^ but rather a commotklity of purpose. Therefore, similarities 
and differences between .v;ocationai evaluators must be .articulated. Jn addition, 
they. -Reed * to articujate the tasks, which they perform, which are. related to vocational 
evaluation 5 and which are. not. ' 

20. The Vecond part of this challenge is to, upon completion of the analysis, con- 
sider together the questions "of theory as related to practice, as well as other ^ 
questions outlined above in defining this topic, so that results might be interpreted 
in some .coptext ^nd, a*s a 'forum, write a statement regarding the results of your 
deliberations-.' 

" ' , ' - RAYMONP A. EHRLE 
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1. Estab. Job Title VoCAjl6^AL P ^Alumi^' Lkuk ^ ' 

2. Ind. Assign. ^qA» /^J^iffl/Htm/ ^/iJ^jTktlf, ^^^ ^ ^/^/!2fe^y^ 

3. SIC Code (s) and Title (sX ' 
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4. JOB SUMMARY: 



)rmed^rat: 



5. WORK PERFORMEDv RATINGS 
Worker Functions 



Data-. . 


People 


Things 









Work Field 4//-Z^y:^^y2»/>»y Afu ^Z/jTa/^^ fi^pj^ 



6. WORKER TRAITS RATINGS': 

GED 1 2 3 4. 5 6 , 

SVP ■ 1 2 3 4 5 6 7 8 9 

Aptitudes ■ G V N S P Sq K F 



M 



Tempei am^nts D F . -I J M P R S T" V ~ > ' 

Interests la lb . 2a 2b 3a 3b 4a 4b 5a 5b 

Phys. Demands SLMHV23456 

Environ. Cond. IOB234 5 67 
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General Education 
' a. Elementaiy 
b. College 



High School 



Courses 



Courses 
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8. Vocational Preparation 

' ' a. College Courses^ 



b. Vocational Education 



Courses' 



^c. Apprenticeship_ 



(3.x Inplant Training 



e. Qn-the-Job Training 



f. Performance on Other Jobs_ 
Experience 



10: Orientation 



11. Licenses, etc 



12.« Relation to Ot% Jobs apd 
Promotion : From 




Transfers: From^ 



Supervision Received_ 
Supervision Given 



To 



To 



13. Machines, Tools; Equipment, and Work Aids . 



14. Materials and Products 
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15. Description of Tasks: 
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16. Definition of Terms 



17. General Comments 
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INSTRUCTIONS FOR JOB ANALYSIS SCHEDULE 



While Neff (1966) listed Job ^Analysis as an Evaluation Technique,' many ' . 

evaluators are willing to admit they do not have the techniques or know the, 
mejihods requi^r^d. *. ' ' . 

The Handbook for Ana ly2fing. Jobs , U,S. Department of Labor, 1972, available 
from the U.S. G. P.O., Washington, D.C. 20402 <Price $2.50, Stock i?2900-0313) 
gives full information on Job Analysis techniques when used with the Dictionary of 
Occupational Titles , Volume II. 

' The following information^ while very incompletjB is edited from Chapter V. 
While to be completely accurate you should use the handbook, you will have a much 
clearer picture'of your Job in relation to the "Vocational Evaluation Project" if 
you concentrate upon items 4, 5, and 7 thru 17. Directions for the other items 
h^ve been eliminated and'^very tentative data have been entered in some of the 
omitted areas. ' " / . . - 

Fot area identif i<Cation, enter your Forum number, in the upper right hand 
comer after the hyphen' in, Es tab. & Sched. No. 'VE 73-100- . 

ITEM 4. JOB SUMMARY . ' 

Enter a brief, yet cojnprehensiye, statement to provide the reader with the 
purpose and nature of the' job, and to reflect the significant involvement (s) of 
tT^e worker with data, people, and/or things, and the level of such involvement' (s) . 
Examples of job- smmnaries follow: 

' a. Solve problems in'high mathematics in such fields as engineering, phyfeics, 
and astronomy (data relationship) (synthesizing level).' . 

b. Sells furniture and bedding (data and people r^felationships) (compiling and 
\ persuading, levels).- . • 

c. Polices premises o£ private business establishment (people relationship) 
* Speaking-signaling level) . ' " . 

,d. Designs artistic interiors ^nd sells decorating services (data, ^>eople, 
and things relationships) synthesizing, persuading, and precision working 
level). • 
e. Supervises and coordinates activities of carpenters on housebuilding 
project (data, people, and things relationships) . 
ITEM 5. WORK PERFORMED. RATINGS 

PROCEDURE FOR RECORDING TORK PERFORMED RATINGS. 

Worker Functions . Express the significant relationship (s) ctf the worker to 
data, people, and/or things by encircling the appropriate, letter (s) Next, 
in the boxes under data, people, and things, ^ter the number that expresses 
the highest level o£ the worker's involvement in each of these three hierarchies • 
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DATA 




' PEOPLE - , 


TIICVGS 


0 Synthesizing" 


0 


Mentoring 


*0 Setting Up 


1 Coordinating 


. 1 


Negotiating 


1 Precision Working 


'2 Analyzing 


2 


Instructing 


2 Operating-Controlling 


3 Compih'ng 


3 


Supervising 


3 Driving-Ops^^ting 


4 Computing 


4 


Diverting , 


4 Manipulating 


5 Copying 


• 5 


Persuading ^ 


5 Tending 


6 Comparing ' 


6 


Speaking-Signaling ' 


6 Feeding-OfTbearing 






Serving " - 


7 Handling ' ^ 




8 


Taking Instructions- 








Helping 
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^ ^ ITEM 7. GENERAL EDUCATION ' . , 

This is education of an academic nature obtained in elementary school, high 
school, and/or college, which does not have a specific occupational goal and is^not 
vocationally orientfed. 

a. Elementary and high school. Enter in the "blanks the number of years 
required, 

b. College. Enter the number of years of general, college education, courses, 
and degrees, if any, required for. the performance of the job duties or for 
providing the phases for specialized vocational education. 

ITEM 8., VOCATIONAL PREPARATION 

^ This is tj^e amount and kind of instruction and preparation required to learn 
the techniques,^ acquire the knowledge, and develop facility for average job, ' 
perform^ce. It is education such as that obtained through high school shop 
courses, in technical schools, as .well as college training which is organized 
around a specific vocational .objective. Vocational preparation also may be 
acquired by apprenticeship, in-plant training, etc. Each item is to be completed 
as described: 

a. College: Enter the number of years, the degrees, the subjects and the 
courses oriented towards a specific vocational goal. List mechanical 
engineering, dentistry, law education, etc. Include both undergraduate 
and advanced degfee work. 

b. Vocational Education: Enter r\u|iber of years and/or- courses that develop 
skills for the specific occupational objective. 

c. Apprenticeship: Enter the length, name/ and/or type of * apprenticeship 
course, if this is one way in which to qualify for the job. 

"d. In-plant Training: Enter here the length of the' training time, and the 
nature and content of such courses. This training is ahy given by the 
employer in the form of an organized classroom type of study, whether . 
actually in the plant or not. 

e. On-the-Job Training: Enter theJ length of this type of training, as a 
learner or trainee > under the instruction of a qualified worker that is 
furnished "by the employer, for an inexperienced ;j:prker to reach normal 
production. (Do not enter the time required f or^^^ienting a qualified 
worker to a job.) ♦ ^ ' : • 

f. Performance on Other Jobs: Identify the job(s) in this establishment 
or elsewhere in which the worker can acquire knowledge and training 

♦ ] partially or to fully qualify for the job, and specify, the length of 

time required for qualifying. ' ^ 

NOTE: If there gre several kinds" of training, any one of which will qualify the 
^ worket for the job, in the left margin of the tirst of such kinds of training, 
indicate the. letter designation(s) of the other altemativeCs) . Example: If 
the job can be entered by means o'f either b. Vocational Educational or e. On- 
the-Job Training, .enter in the left margin beside i^em b "or e". If a cocAination 
of kinds of training is required, insert the word, "and". 

4 

ITEM 9. EXPERIENCE - 

Record in this space the title(s) of any job(s) and length of. experience in 
such job(s), which Lhe employer requires the worker to have had either in the 
establishment under study or elsewhere. Enter thfe^ letters "SE" '(Same Establish- 
ment) in parentheccs after the job title (s) if the required experience must have 
been obtained in the establishment under study. If the employer does not require 
the worker to have had previous work experience,* enter ''None". 




ITEM '10.' ORIENTATION , . 

* Record the "b'reak^in" time .allowed by the employer for a worker to become ^ 
familiar Vith the various phases of the working environment, such as personnel 
policy and practices, job location, lines of supervision, and location of tools 
and parts. Do not include in this it^ information pertaining 'to instructions 
In job duties. ' . ' • ' 

ITEM n. LICEN^S, ETC. . , ^ 

List licenses, certification, or registry which indicate attainment of a 
recognized level of competence and/or which meet Federal, State, or local jrequlre- 
ment^. ' ^ • . * , 

•« 

L 

ITEM 12. RELATION TO OTHER JOBS AND WORKERS / 

"promotion from. Indicate jobs from which persons are promoted to this job. 
PROMOTION Indicate jobs to which persons in this job are promoted. 

TRANSFERS. ^Indicate job(s) from or to which persons in this job may transfef , 
which do not' involve a promotion or demo.tion. 

SUPERVISION RECEIVED. Enter- the title of the worker from whom supervision is 
received, r 

SUPERVISION ;GIVEN. Enter the title(s) of the worlcerCs) to whom supervision 
is given* and the num|)er of persons with each titles 

ITEM 13.' MACHiyt, TOOLS, EQUIPMENT, AND WORK AIDS 

List each At the items used by the worket with the size, approximate weight, 
and other identifying information. Describe in detiil any that are unusual or 
special, and" witji which the reader will not be familiar. In particular, those 
underlined in It<&nrl5 must be described. 

ITEM 14. MATERIALS AND PRODUCTS 

List the r^w ma£erial(s) and/or finished- product (s) with which the worker 
is involved. If any one of these is not conmion or has a unique application as 
used in the job'and is underlined in Item 15, it 'should be defined or described 
in this space. ^ , , . » 

ITEM 15. DESCRIPTION OF TASKS ' ' ' . ^ " 

Describe ill concise form the task performed. Each description must designate 
the worker's ac^ionsand the results accomplished; the machines, tools, equipment, 
and/or work aid^ used; matertals, products, subject matter, or services involved; 
and the- requirements made of the worker'. 

If additional space is n^ded; use supplementary sheet (s). 

In order to provide the clearest presentation, divide the job into its ma-jor 
tasks. Number each' task consecutively and introduce it with a flag statement. 
(The flag- statement is a short summary of the task and should be followed by a 
♦description of tfte elements it encompasses. For many kinds of jobs, the tasks' 
should be descrll?ed in the chronolpgical order in which they are performed. How- 
ever, in other tVpesog.^bs , the tasks should be lis.ted in order of Importanc^e.) 

Indicate in parenthesis at the end of eacii task description an estimate of 
the percentage (jf time required for its performance. The percentage should be on,^ 
the basis of 100 percent for all of the tasks perfbrmed. 

The style ^o be followed in recording the description of tasks should conform 
to the following basic rules: » J 

a. A tersi, d'irect stylie sdould be used. „ • ^ 

b. The pn^ent tense should be used throughout. 



.c« ,.Each sentence should begin- with an action verb. . " . 

d. "Each sentence must reflect an. objective, either specifically stated or' 
implied, in. such manner as to be obvious to the reader. A single verb maV 
sometimes reflect both objective and worker action. ' ' , 

e. * All words should impart necessary information; others should be omitted. . 
Every precaution should be taken to use words that have only one possible con- 
notation, and that specifically describe the manner in which the work is 
accomplished. 

f . The description of tasks should reflect the assigned work performed and 
worker traits ratings. ... 

Keep in mind the necessity 'for seating a t^k completely, but do not allow the 
explanation to develop into a motion study. Fo?-example, regarding an- inspector 
of small parts, it may be said, "Slides fingertips over machine edges to detect 
. ragged^'edg^ and Jburrs . ". ^ < . ' • , 

• On the other hsand", it. wo^ld be absurd- to state, "Raises right hand one foot 
to table height,,superimposes hand over mechanical part and, by depressing the 
first and secon'd fingers to the machined part ..." etc. 

In recording tasks in Item 15, the names of "any. special or unusual machines, 
tools, equipment* and work aids, or materials and products should begin with initial 
capital letters, and be underlined the first time they appear. They should also be 
described in Item 13 and' 14 respecitvely. 

Similarli^, all technical or little-known terin?, or term with uncommon meanings, 
should begin with initial capital letters, underlined, the first time- they 
appear. The words , with initial capitals, underlined, will theh be defined in 
Item 16, definition of terms. 

^ • 

jTEH 16. DEFINITION aP TERMS' ■ ; 

List in alpTiabetical order and define each term "which has been Underlined' in 
Item 15, for example: " ; • 

GROWER'S NUMBER; A one or two-digit number by -which "each of the grower's 
custojners is identified. • 



ITEM 17» GENERAL COMMENTS 



Enter under this itl;^ any conments 'ot explanations necessary -concerning any bf 
the previous items. The analyst should keep in mind the following: 

a. All comments should bear a prop'er dross reference to the section to which 
they relate. ^ 

b. Statements of opinion as opposed to statements of fact should be stated as 
- . sucf^nd, where possible, the reasoning on .which sdch opinion is formylated 

should be explained. " ■ ■ . 

c. ^formation which can appear under other items should appear there, and 
this item should be reserved for pertinent information for which there is no 
specific space alloted. J. . . 
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re VOCATIONAL! EVAIUAT0R: KNOWLEDGE AND- SKILLS 

1. Professionals might be characterized as thc^se individuals who "profess" or 
declare themselves to be performing a work function which is based upon a unique, 
identifiable body of knowledge. profession may be further identified by dngoing 
research', established criteria for training, an association of membership ^with . 

a code o£ ethicf which is tecognized by sdciety, and with'qriteria by which one can 
measure the competence of one's work performance. Vocational Evaluation at this 
time is moving toward professional stature by instituting and increasing its 
proficiency in these areas at a rapid pace. It is 'fundamental for any new field of 
work. groping toward professional stature, such as Vocational Evaluation, to recognize 
and declare its unique sphere of knowledge and skills, and understand the sources 
from which it derived. Vocational Evaluation, as we now- know it, has had an interesting 
development in that evaluators hav^ moved into the arena of examining vocational 
potential from a variety of , related fjLelds e.g., occupational therapy, psychology, 
counsjsling, education, etc., which were somewhat , involved in vocational appraisal, 
but were not in many instances making, a comprehensive effort. Each of these pro- 
fessionals brought different experiences and theoretical orientations, which have 
contributed to .'the present state of the art of evaluation. ^It is' only now that we^ 
are 'attempting to define our territory of unique knowledges *'and skills. 

2. In relation to all th^ pfoceisses of Vocational Evaluation, the area of 
knowledge and skills stands as th^e base or cornerstone of th$ entire field. With- 
out the. skills to do ti^^ job or sufficient background knowledge of why it is done, " 
there would be no field of evaluation! This telng the case, we are led to ask, ' 
what collective knowledge and skills do vocational evalxiatprs possess and how, 

have they acquired them? , ^ . 

3. Speiser (iti Pruitt, 1970) identifies the evaluators* roles with the client as 
a6se8sor, vocational counselor, instructor, foreman or boss surrogate, co-worker, 
psychometrist, caseworker, and case coordinator. Each of these single roles plOs 
a variety of additional roles requires the ^valuator to pbssess separate and well 
developed skills. How does the evaluator come by these skills and what knowledges 
and skills are considered commonly needed? Egerman and Gilbert (1969), surveyed 
293 members of The National Rehabilitation Association identified a^ work evalu- 
ators. They found that the activities evaluators feel they know 'most about are: 
1) administering work samples or performance tests; 2) interpreting work samples 
or performance tests; 3) helping individuals adjust to work environments, 4) job 
skills niBcessary to succeed in specific jobs; and. 5) selecting work samples or 
performance tests. Sankovsky (1971), in surveying 159.VEWAA members, found exactly 
the same result-s in asking evaluators to rate what they^ knew. Further, his study ' 
concurred with Egerman 'and Gilbert in discovering that evaluators felt they knew 
least about selecting, administering, and j^nterpreting psychological tests • 

'a. Hoffman (in Pruitt and Pacinelli, EDS 1969) reports a study designed to 
determine what graining needed to be provided to evaluators. The 189 respondents , 
indicated desire <or more knowledge on work methods and job sampling, the vo- 
cational rehabilitation process, medical and psychological aspects of disability, 
report, writing, counseling theory, communication skills, occupational information 
and analysis, contract procurement procedures, psychological testing, communitjjr 
resources, and information about the world of work. He further reports tl)at in 

i^workshops held at the University of Wisconsin-Stout, evaluators accuracy /mdnual 
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dexterity, knowledge of common machines, topis and shop e<^ipment, counseling 
and interviewing skills, supervisory skills, teaching and training ^^kills , 
organizational ability, interpersQnal relations skills, communications skills, 
research principles, methodology and statistics, job analysis, and manpower 
needs. ' , 

5. Although a number of knowledges* and skills can and have been identified in 
Vocational Evaluation, there is 'some evidence (Nadolsky, 1971) that evaluators 
with different education-work backgrounds attach different degrees signifi- 
cance to tools and techniques within the field'. What kinds of experiences have 
led evaluators toward common methodology, and what differences' exist, and why? 
What training or background is the most beneficial in order to become an evalu- 
ator, and what have the different disciplines from Vhich evalua^iors have evolved 
contributed to the knowledge and skill's we possess? Sankovslcy (1971) found 
that 87%^'of ihe polled evaluators in his study had a bachelor's degree, and 40% 
u-j J graduate work. Educational backgrounds most often reported were 

arts, psychology, sociology and social science, and occupational 



had done 3om< 
in industria 
therapy* 



6. As mentioned, evaluators have brought an enormous variety of work and 
educational backgro:unds to the field. It is interesting to observe, however, that 
vocational evaluators in every area have found like dif f icultiesTBoNnvercome, and 
have moved in similar directions in developing the kinds of expe^tise\ to over- 
come the obstacles. It is likely that some of the excellent information dis— 
tributing processes available in the field have increased the rate of consol"^-^ 
dation of definable knowledges and skills. This is not to imply there are not 
divergent viewpoin£s or methodologies, however, it is striking to not^ the 
similarity of processes occurring ^in a career ^rea^in the infancy of its 
existence. It would ^eem appropriate in discussing vocational evaluators 
knowledges and skills to examine the performance competencies of the best 
among us, for their demonstrated abilities v^ll reflect the knowledges 
possessed and the skill areas necessary to do the job. Due to the multivaried ^ 
settings of vocational evaluation services, it iS' necessary to include equally 
the gamut of performance competencies which might be utilized to a greater or 
lesser degree dependent on the purposes of different programs. This accounting 
of performances of the competent evaluator is for organizational purposes, 
structured under; the areas of tools, and techniques, vocational information, 
communications and Interpersonal relationships, mental and physical processes, 
and a miscellaneous category. . 

Q ■ - ^ • . 

rea of Tools and, 'Techniques, ^valuators commonly demonstrate knowledge 
about the types of ^valuation methods avilable to them, and understand the strengths 
and weaknesses of those with which /thpy work. Within the framework of the assess- 
ment procedure;s th^y have available to them, they can select, administer, and 
interpret the ones necessary for an individual evaluation program. They have some 
■comprehension of the selection and administration of psychological tests, and are 
adept' in the interpretation of thfese instruments. They have the skills to gather 
data from industrial sources, and the imagination to create a work sample which 
challenges the evaluee to perform at hia best, in relation^ to the industrial re- 
quirement. They are familiar with the tools^ commonly used in industry, and can give 
instruction relative to their use. They have the ability to develop orientation 
procedures, basic skills tests, and follow-u'p procedures. They can do a job 
analysis. They can objectively measure physical capacities, and they can appropri- 
ately outline adjustment objectives. • . * 
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8. , Within the area of Vocational Information, vocational„evaluators understand 
l|Dw to provide and use occupational information such as the Dictionary of Occu- 
pational Titles , Occupational Briefs » and the Occupational Outline Handbook . 
Evaluators comprehend the meaning of work in the American society, and they have 
some knowledge of vocational development theories. These effective evaluStors' 
have methods they use in 'understanding the job market, and they know where to. get 
current information on the prevailing conditions. They know the jobs avail^b^e 
within their community, and they understand the job skills required in these jobs. 

9. In the -area of Communications and Interpersonal Relationships, a good 
evaluator demonstrates an understanding of his own personality dynamics and 
can accurately perceive the behavior of his clients • He has the ability to 
demonstrate interest and concern for the client and relate to him on his own 
level. He can conduct meaningful inilrial and exit interviews and carry on a 
counseling relationship when needed. The vocational evaluator is skilled at 
supervising others and in teaching techniques, He understands the jargon of his 
field and can effectively, comiE>letely, factually, and concisely communicate 

the results of evaluation both orally and in written form. He is able to 
handle public relation duties in selling his program, and he has an understanding 
of the roles of other rehabilitation workers. Re is able to relate professionally 
with these workers* in situations sucli as the staff conference. 

10. Within the Mental and Physical Process cajtegory, the vocational eyaluator 
can demonstrate knowledge of the disabling aspects of medical conditions. He 
understands normal bodily functions as well. He has learned personality 
development theories, and has developed an identif icatiion with ^t least one 
such theory; . 

11. Falling* within the miscellaneous, category, an evaluator has a knowledge of 
the history, development, and future trends in rehabilitation and vocational 
evaluation. He is familiar with the philosophies of vocational evaluation, and 
he has an understanding of the total rehabilitation process. He understands 
the VEWAA code of ethics and abides by it. Re has 'organizatipn^l skills, 
knowledge of available community resources, and the ability-- to maintain acceptable 
case records. ' * . • * " 

12. 'These performance competency areas represent where we are now in vocational' 
evaluation. Reflected are the* rather limited areas we have invaded or created, and 
made our field of knowledge and skills^ There are likely minor excJLuSions In the 
listing, but few will argue the necessity of vocational evaluators demonstrating 
proficiency in the* areas listed. ' . ' • 

13. We are witnessing the movement of vocational evaluation fwm its 
beginniugs to a definable entity as a profession in human services. It is 
exciting to be a part of this movement and observe the practitioners pushing 
not only for more Iqiowledge to assist them in their efforts > but also exploring 
new frontiers where they are, discovering their new found expertise in demand. 
Although born in the rehabilitation movement in America, the course is set 

for expansion into areas such as vocational education, manpower, public 
schools, welfare, guidance, and life. skills assessment and adjustment. This ^ 
field is not only the happening place to be, but will al30 heavily contribute 
to where we are headed in the human race. As we expand and exp:j.ore the limits 
of our professional abilities, it will be up to you the clinician, researcher, 
educator, administrator, or supporter of tTiis becoming profession to create 
and discover 'the necessary theoretical framework, traihin^opportunities, new * , 
technology, and performance skills, to make vocational evaluation all that it 
can be. It is a challenging task. How can you jconCtibute? 

RANDALL S. McDANIEL * 
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TRAINING 



!• Vocational .evaluation has been in existence for many years. However, only 
recently attempts have been made to establish a formal pro^fessiont vocational 
evaluation^ In the early stages vocational evaluation was not considered a 
significant i^art of the rehabilitation process except for a select few of the 
severely physicaj.ly disabled. With the increased awareness of vocational evalu- 
ation and the emphasis placed on rehabilitation facilities in the 1965 Amendments 
of the Vocational Rehabilitation Act, a- sudden demand for vocational evaluators 
developed. Formal training programs had riot previously existed. Training was 
mainly confined to the visitation of one or more existing facilities. During ^ 
the visitation, work samples or evaluation materials were gathered, carted home, 
and an evaluation unit was established. It is safe to say that this procedure ^ 
was inadequate at best. 

2. The demands for technical expertise have resulted in the establishment of 
training workshops and graduate and undergraduate training programs. These u 
programs are. still limited in number and there is still a deficit of professionally 
trained personnel in the field. It is also plagued by the growing pains of a new 
profession and the uncertainty as to what the qualifications and demands of the 
field should^ be. Even though- training' programs have been established,* it has 

been difficult to get evaluators to these training programs or the training pro- 
grams to the evaluators. Administrators are reluctant to release evaluators for 
formal training, since there is a short supply, and administrators are concerned 
with delivery of da 11/ evaluation services to the client. This reluctance has 
further deterred the acquisition of the training for development of techniques 
and procedures deemed necessary In the profession.. . • 

BACKGROUND 

3, The technical knowledge needed by the vocational evaluator was exemplified 
by the participants of a "think tank" workshop on work evaluation conducted at 
Stout State University (1969). Participants listed the f ollowlng>s;^petencie8 
and skills as being a necessary part of the knowledge of the vocatioia^l evaluator. 




Ability to: 



Knowledge of: 



Develop work samples 
Administer work samples 
Conduct on-the-job assessment 
Administer psychological tests 
Conduct job analysis , 
Write brocltures 



Theory of work ev^^^ 
The DOT ^ ^ 
Work characteristics 
Occupational Information 
Medical aspects of disability 
Psychological aspects of disability 
The total process of rehabilitation 
The principles of . phlfosophy of reha- 
bilitation ' * 
Adjustive aspects of dd^sabllities 
Community resources 
Personnel management 
^valu^U^n^^^gecla^^i^^ 



Articles <pertainliig to evaiuator training are ^uite limited, but most .educators 
agree that there id a need for training in theJcofapetencies as outlined above. 
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4, Despite this identified need for technical knowledge, a study by Sankovsky ' 
(1971) revealed that only 60% of 300 VEWAA members surveyed had received any 
formal training. This study went pn to point; out that 87% had received at le^st 
a Bachelor's Degree, and 43% had some graduate work. Of the evaluator group with 
degrees, 27% reported backgrounds not traditionally associated with rehabilitation, 
27% had backgrounds in Industrial Arts,' 5% reported a psychology background, and 
25% reported a sociology or a social science' backgound. The. study also revealed 
that 75% of the evaluator group read the VEWA/i Bulletin, and that 80% had attended 
professional conferences within the past two .years, primarily at the State level. 
Only 60% of the evaluator group reported receiving. at least 3 weeks of in-service 
training. ' ' 

♦ 

5. Attempts have been maJe to provide training which practicing evaluators identify 
as needed. Ralph Church (1971) alluded to the regional short-term Institutes 
designed to allow an exchange of ideas and information as they apply to problems 
within, a i^efeion. In 1965 and 1966, the Institute on Rehabilitation Services (IRS) 
gave an' Intensive effort to evaluation and work adjustment. The purpose was to . 
define problems that develop solutionsVso that better services might be' provided 

to the disabled. 

^. IRS in 1972 conducted a study entitled. Vocational Evalixatjon and Work Adjustment 
Service in Vocational Rehabilitation . The purpose of the Prime Study Group ^s to 
develop materials to be used in training,.£Ounselors and other rehabilitation 
personnel in the effective selection and utilization of vocational evaluation, and 
work adjustment service in rehabilitation facilities. Since material defines the 
essential elements of vocational evaluation ^nd work adjustment, the manual mi^ht ' 
be used in planning facility staff training programs, 

7. Other training has been developed in thi form of »in-service training. One 

such program was initiated at Auburn Universityv In this program, the Rehabilitation 
Education and Services staff of Auburn University conducted a ''mock" accreditation 
survey of all th^^* rehabilitation facilities in Alabama. The purpose of this survey 
was to determine. how close the facilities were to meeting CARF^s standards, and .to 
determine arQ^s of deficiencies and ways to" correct these deficiencies. Facility 
.administrators and state agency staff were brought together in small groups to 
plan program objectives they would like to see Implemented into their facilities. 
Following the identification of objectives, the service staff members of each 
facility were brought together, and plans were made tor the implementatldn of the 
objectives. The Aubu;m §taff then visited each facility to give assistance in 
deficient areas, apSto insure that the objectives were implemented. This approach 
seems valid in tfiat it provides assistance and training in areas of Individual need. 

8. 5ome practitiWers question the totality of classroom work in training vocational 
evaluators and adjdSter^.^^ — P^ul Lustig (1961) stated, "One can learn to administer 
and Interpret various-^^if f erent kinds of ^aptitude, ability. Interest, and "personality 
tests. One can learn to become more aware of an increasing number of factors in 

'the person. .There^ay, however, be some aspects of evaluation 'that cannot be taught 
directly, but rather may require the experience of working, both ars an evaluator 
and in other occupations." He further states, "The person who has been a student or 
who has held one or two jobs is probably less able to evaluate than the one whd 
has had several jobs." He feels that the evaluator should have "adequate competen- 
cies" in Several job skills. "Since the predictive ability of most instruments is 
rather ],ow, the evaluator with little or non-varied work experience must depend in ^ 
a large part on the objective measuring instruments or his biases, which result from 
lack of work experience." 



9. Xn *jdaifrying the vork idea further, Minnesota. Metropolitan State College-^-s 
established a degree program without a central or formal campus. The major pbrtion 
of this/.staff , consists of , people who are not responsible to the college. The pro- 
gram utilized. rehabilitation facilities as learning laboratories and rehabilitation 
'workers afe -faculty. The training-stakes place wherje the action is. 

10. The ne^d for both theory ^nd practical experience is exemplified by the three 
Universities offering degrees in vocational evaluation. Auburn, Arizona, and the 
University df Wisconsin-Stout, provide^ for the learning of theory as well as< the 
application Qf this theory in a practical work setting within University-operated 
evaluation and! .adjustment facilities. 

. ' . ' ' ' ^ ' 

' " . .ISSUES 

. ^ \ » ■ • • • 

11. In regard to educa'tipn, I feel that there lis a need for both practical 
(vocational) and formal Xa<^demic) training* Although formal training may be 
ideal, I do not see an eval^tor completing an evaluation of a person *s skills 
in a technical' trade without having some working knowledge of that trade. "On 
the other hand, the person without thfe academic training may have difficulty in 
expressing himself, or in understanding the variety of disci-piines and knowledges 
encountered in providing rehabilitation , services. The key to t'his problem seems 
to be the blending of appropriate, p'ractical, and formal training through formal 

' education, short-term institutes,'. practical work experience, on-tl^e-job tradln- 
Ing, and/or in-service training* ^ *»' - . 

12. This then brings up the problem ofj^he availability of adequa'te practical 
and formal training.* The formal training programs are few and can accommodate 
only limited numbers of trainees. These programs try to accofinodat'e short-tenn 
training programs and institutes^ but, again, they are limited by the number of 
evaluators that can participate. Few facilities have enough adequately trained 
staff to conduct in-house, in-service training. This could be offset by the 
Universities providing technical consultation and materials to .assist facilities 
in conducting in-house, in-service training. For those states who have a VEWAA 
Chapter, much training can be accomplished through thlg Organization. As the 

VEWAA programs are presented* on a regional or national basis, the content of the ^ 
program tends to become more general and does not necessarily meet the specific 
needs of individuals. Even with the establishment of these^ training programs, ^ 
.the problem, of the evaluators being freed to attend still ©cists, ' 

13. Those individuals completing formal training programjin evaluation should 
obtain a great amount of thepretical knowledge. Unfortunately, too many of these 
people, because of the shortage of advanced degree personnel, are placed in 
positlpns of administration and supervision and never get involved in' evaluation. 
This hinders their ability to act as trainers for other staff. It also reduces 
their effectiveness by not allowing the practical experience necessary in com- 
bination with formal \raining. . , 

14* Practice and training should be ba$ed on theory. There is, however, some 

question as to whether there i§ a uniVjer sally-accept ed theory or body of knowledge 

in vocational evaluation. Without this^ can effective training programs be developed? 

*, 

15.. Assuming that there is an accepted theory and that training programs are 
developed around these theories, there is still a problem of implementing thitf 
knowledge to the everyday problems encountered in vocational evaluation*, 

16. Today, three Universities are offering degree programs in vocatioijal evalu-' 
Lf"^lon. Their curricula include the teaching of thedry and the opportunity to 
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implement this theory in rehabilitation facilities located on the campuses • This 
approach seems to have at least two advantages': It allows the student (1) an 
oppoftaalty to test the theories ^e has learned in the classroom and (2) to have 
immediate consultation from the University staff whe^ problems arise in the "real 
woria" of V vocational evaluation, 

17. Altl^ugh formal training is ideal, the actual Implementation of the theories 
and ideas is something else. Too often we forget that we are working with clients 
with individual pro.blems and under individual circumstances. Because of this, I 
feel that a good training program, whether it be formal or in-service, should 
consist of both text book theory and an oiii-the-jo'b practicum. 

18. There have been studies and surveyff in the past that have disclosed the train- 
ing level of evaltiators — what resources they turn to for professional upgrading and 
what they see as training needs. Because of the rapid expansion of evaluation and 
the recent emphasis on research, a constant re-evaluation of the training needs, 
training practicum, and required level of training needs to be done. With this 

in mind, the following are some questions that ne^^ to be considered: 

1) What is the current training level of the evaluitors? What ty^e 
of training have they had? Is there a need for formal training? 
If not, why not? If so, support your convictions. Is it necessary 
to be trained in the field in which you are doing evaltiations or 
is general theory sufficient? How many evaltiators have a college 
degree? How many have an advanced degree or advanced training? In 
/ ' what field? 
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2) What theories is the evaluator utilizing in theT^ractice of his i 
— ^*ert**?^ VhSiZ shoulS be i^luded in the training of\an evaltiator to • V 

meet today's needs and tomorrow's challenges? Who should be respon- ' » 
sible for the training of evalxiators? The Departmesnts of HEW, Labor> or State; 
State; the individual, or the University? Should training lead to the 
certification of ^an evaltiator? How many evaltiator s attended short-term 
seminars? 

3) What use has bee^ made of training materials and self-help? How many' 
have had an opportunity to take a stmuner or a month off to participate • 
in a training program and, how many of these have ^received tuition , 
or part salary during the training program? 

4) Does the average Evaluator read the VEWAA Bulletin and other periodicals 
published on evaluation? Does he participate in local forums atid/or * . 
professional rehabilitation or inter-agency, intef -disciplinary sessions? 

; Does his facility offer in-service training sessions? How is the content 

of the training sessions determined? 

5) What are the best training experiences? How does this training relate 
to the job Vocational Evaltiators are doing? What are the areas in which 
Evaluators feel the most inadequate or most in need 'o£ training? 

V > 

19, This paper was originally intended to be a stimulant to discussion by the 
local forums involved in the VEWAA Project. It was their challenge to create a 
statement regarding the reality of their training, both formal and experimental. 
Idoitif ication of the type and extent of training needed by^ the evaluator remains a * 
Ojtallenge to practitioners if the profession of vocational evaluation is to continue 
to develop and improve. ' . . * , » 

O ' ' , » 

^ ROBERT E. MAYES ^ 
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30- . WORK SAMPLES 

!• Vqcational or work evaluation is the process that Attempts to assess and 
predict' vocational potential and behavior through the use of various techniques 
and methods; The objective is to accurately place the client in an appropriate 
vocational setting by correctly assessing his interests, performance, and 
behavior. The methods (tools) commonly associated with work evaluation are: 
(1) on-the-job tryout or evaluation; (2) production or "situational" evaluation 
(although the "situational" approach has been used to define subcontract cvalu- 
. ation, I feel this is an inappropriate term to use in this context); (3) 
psychological testing,; and (4) work sampling. These methods are u.sed to provide 
settings where evaluation of the multiple factcars associated with the assessment 
of' a client^s potential for the world of vork can be made. The work evaluator, ^ 
weighing the advantages and disadvantage^ of each method, would probably use any 
combination which best suits his purposes.* 

2# ^Of the four methods used in evaluating work potential, the most realistic 
would be evaluating clients in an, actual work situation since the flloser the 
testing method is to the real situation we are measuring, the better. The best 
testing method or evaluation for a job then would be the job itsejj. In such ^ ' 
a setting, all the working conditions and environment 'would De^actual, and we' 
could readily assess how the client functions in a real jab. However, using the 
"on-the-job" metbc^d without some form of prevocational e'^aluation would be, 
a hit and miss effort, time consuming and frustrating for the client, employer, 
and the evaluator. Since the efficiency of this metfiod is optimized when it 
follows some other method of screening, today more thought is being given to 
using this method after Initial prevocational evaluation is made. Despite the 
fact that the literature states that job sites a^ difficult to find, and that 
this method is expensive, programs using the "on-the-job" evaluation method 
have reported excellent results. Since the appraisal of a client doing an actual 
job in industry also offers us an evaluation of the effectiveness of our other 
assessment techniques and ^judgements, it can be a valuable criteria for judging 
these other techniques. 

3, The production ot situational apptipach to evaluation is the method of 
evaluating clients through the use of subcontracts in a sheltered workshop. 
The client is evaluated on actual industrial work brought into the workshop 
on a subcontract basis. By observing the client in this setting, the evaluator 
could gain insight into the client *s potential for work. In this setting, 
wages are paid to the client for woxk on actual commodities. The main difference 
between the "on-the-job" and production approaches is the ability to vary all 
the customary conditions of the reaf job in" the rehabilitation setting ip an 
effort to discover difficulties that prevent the client from working effectively. 
Problems with this method have resulted from the. ineffectual way it has been 
applied, and not with the method itself (I think this can be safely stated ^^rith 
all four of the evaluation methods) . Sheltered workshops can be criticized for 
being too permissive, for not setting up an industrial environment, and fo^not/ 
setting up the contracts in an industrial fashion. All too often tj^ Y^'^^ p 
atmosphere in a sheltered workshop bears faint relationship to the atmosphere 
in an actual industrial setting. These critici^Ss could, be corrected by using 
better methodology in order to organize the workshop as much like an industrial 
setting as possible. One legitimate drawback to the production method is that 
the types of work available for client evaluation are restricted to the con- 
tracts that cdn be obtained from industry, . 
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4, The method that has. drawn the most criticism, as an evaliiation approach, 
is psychological' testing. Of the four evaltaation methods, psychological testing 
is the most removed from assessing ability for those jobs that we consider 
feasible for the tjrpe of client normally seen in rehabilitation facilities. 
This is due to the fact that psychological tests often measure cognitive 
abilities, rather than the psychomotor abilities which are related more closely 
to most industrial settings. Also the psychological testing method is ineffective 
in evaluating a l4rge minority of the "disabled population who have low literacy 
levels and have had unsatisfactory experiences with such tests in school. 
Psychological tests in themselves are not an ineffective method of evaluation. 
It is the improper use of the tests, not the tests themselves, which *may cause 
the problem. If the traits .measured by the test are clearly understood, and 
the limitations and skills njscessary for taking the test are adequately con- 
sidered,^ then the evaluator should be capable of judging the appropriateness 
of the instrument in question. 

.5. Since the work sample is a sample of work based Upon a job ana-lysis of 
the industrial operation, the fourth method ~ the work sample should approxi- 
mate real -life jobs more closely than psch'ological testing.' The work sample - 
should simulate tl^ complete range of work activities, (motions,, mental func^ 
tioning, performance demands, operations, materials and equipment used) that 
comprise a particular job pr occupational area. The objectives in using a 
work sample are to assess and determine job skill potentials and, to a degree, 
work relevant behaviors. These can be accomplished to the extent that_ the work 
sample does not differ in its essentials from the kinds of activities a potential' 
worker would be required to perform in an actual industrial job. The work sample 
can be the actual job itself, (job saciple) or a closd simulation , or mock-up 6f , 
the actual industrial operation. There have be6n efforts to develop trait 
samples, (finger and manual dexterity, eye^hand coordination, color discrimina- 
tion, etc.) but so far the trait samples have shown littlfe face validity for^ 
actual jobs. 

6. The suitability of a given j.ob area for work sample developm^iVtshoj^ be 
a function of: (a) whether a job market exists for the job which tKesample 
tends to assess and (b) whether the requisite skills required for ,the job 
area are possessed by the intended client group. In principle, all work 
samples should represent the complete range of activities and components 
' that have been abstracted from an actual .job. The' developer of a work 
sample should start with a detailed job analysis of all the industrial 
operations, conditions, and activities of fhe job that he wishes to predict. 
In developing the *work sample, all the work activities, materials, tools^ 
layout, and physical conditions should be maintained as close to the actual 
job as possible. It is important that the work sample involve Reading and 
other cognitive skills, only to the extent that such sKills are called for', 
during on-the-job performance. Instead of work samples being designed ai)d dsed 
to assess abilities for .a single job, we should atteifipt to make them as broad 
as possible in application, by extending validation efforts, to a multitude of ^ 
jch). situations sharing a common basis of similar activities* . ^ 



7. Many requests have been made for information on work samples designed 

for specific disability groups, such ^s mentally retarded, blind, disadvantaged, 
welfare, recipients, etc. I do not feel that any work sample should, or even ■ . 
could, be designed for a given disability group for the following reasons:*' 

the purpose of work evaluation in relation to vocational rehabilitation is 
tq evaluate people for "real", "actual" jobs, regarcjless of th? disabilities 
involved. If a realistic job exists where accommodations .can be made' for given 
disabilities, then those accommodations should automatically be -included in a* 
valid sample of that job; (b) we must concentrate on what the client can and 
caijnot do and not on the "disability label" he may be wearing; and (c) tl^e admo- 
nitio^ that we shoujd not specif ically *desi^ work samples for given disability, 
groups would nqt preclude identifying job areas and/or job samples which have • 
proven, or may prove in the future, useful with different disability groups. 
The. work sample is a sample of actual work. It is designed and developed so that 
itWJd.ll fenable an indi-^idual, regardless of his disability, to be assessed 
for a job or a group of jobs. ^ 

8. '- The jnaj or advantages for "the work sample method .include: (a) the work 
sample (developed by joB analysis)* is as close to the reality of work as we 
can get within the rehabilitation facility (except for actually putting xlients 
to«A?uck in the facility)'; (b) it provides exposure and experience on a wide 
range of jobs^ (c) performance identical to work is required on the assumptipn 
tl^t the closer the ^work sample is to the criterion, -the more li,^^y it is to 
be valid ;^ (d) it not only assesses skills 'but reveals aspects of the client's 
personality, interest, motivation, arid attitudes towards the 3«ob; (e)^ clients 
respond more naturally to^meaningf ul rather than abstra.ct tasks; Cf) it can 
eliminate cultural, educational,, and language barriers in the assessment of 
vocational potential; and (g) many prospectjLve employers are more^ receptive 

to utilization of work sample performance than predications^ from othei; sources. 

9. " Some of the disadvantages for the work sample method include': (a) work 
samples teijd to emphasize quality and quantity of production, rather than person- 
ality factors; Cb) developing work samples for the many different types of jobs 
in the labor inarket is unfeasible; (c) workers are part of a working, social 
facH-ly - and the social experience, reactions from co-workers, heat, noise, 
motivation, and w^ges vary so considerably in our shops that there is little 
comparison between -the environment in industry and the work sample method; 

(d) 'we're really not measuring the actual job; (e) because work technological 
change is so rapid, we run the risk of developing a' good appraisal instrriment 
for jobs which no longer fexist; and (f) work samples have not often used statis- 
tical methods to develop reliability and validity Information. 

10. '^ ^f a work sample is to represent an actual sample of work in industry, 
ceriain considerations would have to be made in developing the sample 4 First, 
one would need to decide on the job that the sample is supposed t9 represent. 
In observing the jot, a job ^nalysi^ would have to/be performed to make sure 

, that all ^he elements, components, and traits of the work are understood and . 
» replicated. It is only by this process tbat we will know what samples of work 
^ are, inherent in^the jo^, and 'to understand what we are measuring. So of^en, 
ffottf my experience, when you ask an ev^liiator what the work sample he is 
administering actually measures, he cannot tell you this. I feel that is ex- 
tr^ely Important in a. work sample to be able to identify and know what it is 

> . . ' ' ' . I ' 
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you are measyringt Second, how does Vhat'you are measuring actually relate to 
jobs .in industry. The primary way of accomplishing this with a work sample 
would be to actually' do a job analysis an4 develop a work sample as 'close to , if 
not identically to,' the job thaU^^otj^-ar^^an^lyzing. It is understood that the , 
total enviifonmental conditions that the job is performed under cannot be « , 
simulated,. but the actual work performed can be. This should be the first 
consideration in developing the job sample cv^^xk sample. The work sample 
should ^be able to show some empirical data demonstrating that the sample, used 
correctiy, measures some *skill, aptitude, knowledge, or characteristics which 
are reliant to the job in question/ This will only occur when (a) the job 
analysis presents a truly accurate relection of the actual job, and (b) the 
watk^sample Jias content ;v&li^it?5^ with reference to the^job analysis. There- 
fore, the work sample itself wilL be predictive of, or significantly correla- 
ted \d!ihi important elements of work behavior which are related to thd job\ 
EvaXuators have failed to realize that their work sainple tasks may be rather 
narrow, and have no resemblance to how the work is performed in industry by 
the employed worker. . \ 

11, For effective use of any work sample, a manual is required. First, it 
serves as an informational training aid for evaluators previously uhfamiliar 
with the sample. Second, standardized adminis*tration procedures become diffi-- 
cult, if not .impossible, without .a manual offering uniform procedures for 
administration; utilization, and interpretation. In order to maximize its 
benefits, the work sample- mantial should contain complete administrative 
Instructions for the,e\;aluatoj. These would include: (a) complete list of 
all materials, tools and parts needed for the sample; (b) information pertain- 
ing to where* to purchase any items needed if the items are not available ^ 
locally; (c) detailed instructions and diagrams a*s to how to* build and set 

up the sample; and (d) any additional" special instructions to the evaluator 
that would assist in'the setting. up of 'this work sample (or even possibly 
the environment) as it was designed to be performed in industry. The above 
information is absolutely necessary since, if, industrial norms (or any <norms) 
are provided with, the sample, any change* in layout, materials, or any compo- 
nent of the sample's original design, will invalidate these norms. Norms 
should be based on administration of the sample in the exact manner designated 
by the- instructions, ,v ' ■ 

12, Instructions given to a client, prior to his beginning a work sample, 
serve three major purposes. The first purpose of client instruction is to 
orient the client to the relevance of the work sample for jobs iu the community. 

,Too often, a client is gl^ven a work sample with no explanation of what is being 
assessed, or how such assessment can be meaningful to the client in his vocation- 
al exploration. This orientation should enable the client to perceive the . 
relationship .between the task he is to^ perform and the occupational area 
it ^represents. An audiovisual presentation with the use of videotapes, 
slides, or filmstrips can be very effective in accomplishing this first 
purpose. The presentation should inolude a statement of the purpose of 
hdministering thfe Sample and, -.if possible, pictures shoeing the job being 
performed in industry and other similar work settings in industry and other 
.similar work settings in industry, for which the results of the work sample 
is relevarjt. It would be helpful to have, in this presentation, information 
as to salaries, working conditions, and the future employment market for 
thfe job that the work sample relates to, . If visual presentation is not feasi- 
ble, the introduction to ^he sample can be, either audio taped or printed, and 
used in conjunction with photographs of the jobs being performed in actual 
industrial settings. 
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13. A second purpose of client instruction is to instruct 'him (the client) 
as to what he is to do and how he is to do it, exactly as these instructions 
would be given to him in industry. This first involves an analysis of how 
industrial employees are instructed to perform the operation on which the 
work sample is based. The purpose there is to find out if .the client can 
perform the task, based upon the instructions as they would actually be given 
by industry. These instructions could be standardized and could easily lend 
themselves to an audiovisual presentation. It might even be a more effective 
and.reali^ic method to have the foreman in the industry, where the work sample 
was developed, put the instructions on tape and use this as the standardized 
instructions for the client. • . 

14. A third purpose of client instruction is to aid in the assessment of 

how well the client can learn to do the task if he does not perform adequately 
following the standardized industrial instruction. If the client cannot 
perform the task from the standardized industrial instruction, we must then 
determine what type(s) of instruction will facilitate the client's under- 
standing of the task to be performed in the work sample. Some clients may 
need repeated instruction, with a great deal of demonstration, while others 
learn by Imitatipn, where the evaluator does each step, of the process, and 
the client then imitates each step following the eyaluator's example. This 
phase of the client instruction can both convey to the client what ^he is 
to do and, how and while doing this, assess the learning abilities of the 
client. The client's ability to learn, his retention and most efficient 
means of attaining learning, must always remain separate from the assessment 
of performance. In this context, learning ability and performance ability 
can both be measured by the work sample. The criterion for deciding that the 
client understands the instructions, on any work sample, is the performance of 
±he sample correctly a given number of times. 

15. Once the client has demonstrated his ability to perform the work sample, 

we can then measure his performance. A basic problem in the utilization of work 
samples has been how to relate the client's performance to some known objective, 
or standard of performance. Realistically, we should compare the client's per- 
formance on the work sample to the actual industrial production level, to deter- 
mine if the client's abilities are competltve» If the work sample is constructed 
from existing work in industry, it should be relatively easy to get both quality 
and quantity standards from the job itself.* These standards can then be utilized 
to compare the client/s productivity with those of workers in industry. When 
comparing a client with industrial standards, it should be noted that the person 
in industry has had experience in doing the task. To compensate for this fact, 
the client should be allowed to practice the work sample (as many times as neces- 
sary) until it can be determined whether or not the client can achieve an 
industrial competitive level. ' - • 

16. It has been my perception that client norms are limited in their useful- 
ness. With the use of client norms, all you ^an compare a client with is 
another client. We should remetnber that our major goal in rehabilitation is 
to plax:e the client in a "real" job. If we are Interested In assessing a 
client for jobs in* the community, we must then have industrial norms. One 
meaningful use of client norms would be to assess the client for jobs within 
a sheltered workshop, which vould require that some comparison be made be- 
tween clients. An alternate way of constructing industrial norms, in addition 
to measuring the productivity of people a ctua lly on the job, (which I feel is 
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probably the most effective way of getting norms) would.be to use 'the services 
of industrial ^gitieers who can develop industrial norms, using predetermined 
times. Industrial, engineers ^analyze any job,, and can determine by the measure- 
ment of all motioij§^ )in this job, how long it shbuld take an experienced 
person In indust;ry5to complete the task. Once the industrial norm is de- 
'veloped, the literature indicates that a client, who can reach approximately 
70 to 75% of this ;Lndustrial norm, should have the minimum qualif icationsT 
for obtaining a j(^b in that industry. 
( 

17. For evaluation to be effective, we need to evaluate the whole person. 
Our evaluations o^ the client *s abilities, skills, and interest alone are 
not enough. Many attributes oi^he client, presently not measured 
in any quantitative way, are more determinant of employability than the 
above measurable attributes. These Include motivation, vocational self- 
concept, relations with supervisors and co-workers, initiative, ability' to 
accept criticism, attention span, physical stamina, emotional maturity. 



and the ability ta improve in ayy of these attributes 



Scoring and pbser- 



vation of performance on worK^sks can provide leads to many personal 
qualities of poss^Lble relevance\to particular jobs. Trtiese work attitudes 
and behaviors are often more crucial to an individual's acquiring and holding 
a *job in industry ^an such factors as ability to follow directions, tool 
usage and work method. At this p^Dint, we are trying to assess what behaviors 
become evident that we feel will stop a pci. son from perf-ormlng satisfacto- 
rily in the world of. work, while working in a simulated work situation. We 
should realize that: since the environment of ap< evaluation center does differ 
from an actual work setting, the behaviors or the client during the evalu- 
ation process may not accurately reflect eventual job-related behaviors. 
Due to close supervision during evaluation, a client may demonstrate test 
anxiety behaviors that would not appear during later performance on the job. 
Many evaluators, in the field, feel that this affective, subjective, behavior- 
al evaluation is probably the most significant part of the total evaluation. 
There are numerous studies vhich indicate that it is not the client's 
inability to perform on the task whlcli gets him fired from a job, but hid 
inability to adjust to the work envirormienc . 

18. By and large personal qualities ^or behavior characteristics revealed 
by the use of work/ tasks are generally subjectively determined by evaluators. 
The quality of the' appraisal, in regard to behavior characteristics,, de- 
pends upon the dep[th of the evalyator's psychological insight and his 
ability to communicate his .observations to others either orally or in 
writing. As stated previously, the area of vocational evaluation' that 
many evaluators consider to be the most crucial is dealing with behaviors 
and attitudes in /relation to the world of work. Many evaluation units are 
primarily interested in the client's work habits and social relationships, 
rather than job skills or j)Otentials. There is, however, eventually a 
need to determin^ the client's specific skills .and potentials fbr ulti- 
mat.e employment.^ It is highly questionalbe whether the supcess of vocation- 
al evaluation isf due to: (a) the methods used for evaluation; (b) the - 
competency of the evaluator; or (c) the evaluator's ability to relate to 
the client and handle daily adjustment problems.* Training programs should 
prepare educators to obtain taore accurate observations and perceptions of 
the client's sodial-psychological framework with reference to the world - 
of work. 
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.19. The major purpose of work evaluation is to serve the client ^ and 
to provide him with the insights, self-understanding, ^nd Ufi/ormation so 

_J;hat he can make his own yopational and life decisio;^s'more realistically. 
This is why the evaluation setting and, methods used should be as realis- 
tically set up as. possible, to emulate a work^^tting. This reality 
orientation will then enable the client to percSlve-the relationship of 
the task^ they are performing to the occupational areas of the world of^ 
work. This aspect of making the evaluative process "face-valid" is ex-' 

.tremely important in maintaining the client's, morale and cooperation. 
In this regard, it would be helpful even if the .client could be paid (on * 
an industrial scale) for the work he is doing. It is possible that some 
cliettts are affected by financial incentives more than others. The 
ab senc^ of incentive in work sample testing yould elicit ^perfoinaanoes 
from these individuals which are inferior to their performances under 
incentive conditions. The 'above mentioned problems could be solved by an 
orientation which deTscribes how the sample relates to actual jobs in 
industry^ the use of performance charts, and, possibly, incentive pay t'o^ • 
show the client how. he compares on an actual skill level, to people in that 
industry. The main theme of work-sample-based vocational evaluation was 
and remains the enhancement of individual exploration and self-discovery. 

20. The above paragraphs dealing with work s^!6ples have tried, to come 
to grips with making work samples more meaningful for evaluation, and for 
the client to b6 able to better evaluate and understand himself. The 
charge to the forums involved with this paper is; ' . ' 

1. Your comments, either agreeing or disagreeing, on the views 
expressed and other views you feel should be stated to help ' 
in- improving the work sample method.^ ^ 

2. The degree to which you feel .the viewpoints expressed in this 
paper reflect the substance and utilization of'wojk samples, 
as they are being used in work evaluation. ' y 

3. Your cooperation in submitting work samples that you have 
developed to the Materials Development Center, University of 
Wisconsin - Stout, Menomonie, Wisconsin 54751,, so that these' 
can be shared with other evaluators throughout the country. 



ARNOLD SAX. 



. . . / . 



ERIC 



. " mf. CHALffWGES/lN WORK SAMPLE EVALUATION . 

1. Traditionally, work samples have been utilized with populations for which valid 
measjurement with paper and pencil tests is unobtainable. These groups may be low In 
verbal and reading skills, test shy, or unable to telate to standard testing situations 
for ^ny number of reasons. }Jork Samples are not usually administered to individuals 
who obviously lack vocational problems. These indivi'duals can be assessed by a 
variety of readily available paper 'an^ pencil tests>. 

2. Performance, behavior, and interest are generally considered to be significant 
factors in vocational assessment. It is possible to arrive at conclusions about 
them through either intuitive or measurable techniques. The Philadelphia JlEVS 

1 has established empirical norms for their twenty-eight work samples which have been 
4;sed in a variety of settings. Because of the standardization of administration 
and objectivity in scoring, performance can be quantified. However, it is Con- 
siderably more difficult to obtain an objective assessment of behavior and interefst. 
The prevailing tendency is to have behavior and interest assessed, in a subjective ^ 
manner,, by an evaluator vho Is usually trained to make reliable observations and 
conclusions, in^ these areas. Validity, neve^jptheless, iremains an unknpwn quality. 
What has been done to produce objective measures of interest and behavior? A 
review of research, in this area, yields no sigi^lficant studies which attesf to the 

, predictive validity of interest and behavior mj^sures cpll§a^d during work sample 
evaluation. Yet, virtually every system pjf wOrk sample evaluation provides infor- 
» mat ion regarding behavior and interest. Attempts have bfeen made to ,quantify be- 
havior^and interest with check l±sts^ and standardized observation, but successful . ^ 
resul^l have ylet ^o be reported, this is a problem in all ^contemporary work sample 
evaluation .technique^, * ^ ' 

• 3. Use of Vfork samples in* public manpower "pragrams^s a more recent innovation. 
Xhe main body of/wiirk-sample research has dealt jsflth V^rformance norms. Review of 
the literature d^dibates not only continuing GCJncern regarding performance norms, 
^but also points put an increasing need for truly objective reports of behavipr and 
int^esi.. When questioned about their ne^d for this information, counselors in 
work-gapple facilities throughout th^^ntry stressed its Importance in placing 

. cl±em3 on the proper job. ^ ^ ^ ^ , 

4. Work samples are an evaluative technique, and not designe^to' produc^ a signifi- 
cant change in th^ individual being assessed^ Their objective is the measurement 
<of performance, interest, and behavior in order to accomplish .the goal of accurately 
placing the client in an appropriate vocational area, whether it be employment, 
training, or the next step in a process of vocational development. 

. 5. Deviations from' standardized admiuistration and scoring Of work samples have 
the effect of reducing their value aS an assessment device. These deviations' may 
affect performance, interest, and' behavior, either separately o^in some combina- 
tion. If, ,for instance, a client's performance is discussed \^ESh him after complet- 
ing .a work .sample, it may -have an effect upon, subsequent vrork samples.. 

^ 6. Another deviation is the labeling of the work samples, . during th^ instructions 
given to the enrollee, as "boring" pr "repetitious". This labeling could negatively^ 
influence the client in the development of his own feelings about the work sample. 
Different people view- the same work sample in different ways. What is frustrating 
or boring to one individual may not be frustrating or boring to another. 

7. A third deviation, and one that is frequently requested by counselors every- • 
where^ is administration of the work sample battery in parts rather than ±rx Its 
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entirety. This is hazardous, unless validated for "partial (cluster) use, since 
work samples were standardized ^s a complete battery, not a© individual units 
with no effect upon one another. What njgy be appropriate norms for a work sample 
in a battery may not be appropriate for the same work sample when given alone. . 

B. It is also important, however, that work sample practitioners be flexible. The 
Philadelphia JEVS has investigated changes in the work sample battery as used in 
manpower, systems. For instance, in order to T>ett.er evaluate marginal skills, it 
might l)e advisable to establish a procedure for ^e-adininistering failed work 
samples. Such a procedtre which could lead to better knowledge of the individual's 
true skills would T^e analogous to the situation in industry,, where an individual 
is not expected to learn the job requirements in one try. Of course, any change in 
work-sample procedures would come about as a result of empirical validation and 
. comparison, with ekisting procedures. - \n 

9. The most acc^irate assessment technique is of no value unless utilized effec- . 
ttvely. The factors mentioned earlier — performance, interest, and behavior — are 
useful to the counselor only prior to an important vocational decis^ion. Conse- 
quently, the chronological integration of work sacples into the total assessment 
process is crucial. For example, in sjome Manpower programs, the employability * ^ 
development plan was drawn up before the client was fully assessed. This resulted 
in failure t;o change the plan when necessary, and the clij^nt was not properly served. 

10. Work Sample information must be prov^-ded to the counselor in job, related terms, 
rather than In psychological constructs, which may not be sufficiently understood. 
Job related information is more familiar to the counselor, and will better enable him 
to analyze tlie client's vocational potential. In order to best utilize vocational 
information .provided .by wprk samples, the counselor should be well trained in the 
basic prdcesses of wotk sample ^valuation. Because work samples do noti exist in a 
vacuum, they must be related to some system, which the counselor must also know. For 
example, the Philadelphia JEVS Work Sample System is directly related to the Worker 
Trait Group Arrangements of the Dictionary of .Occupational Titles . If the counselor 
is not familiar witli this classification scheme, the evaluation is worth significantly 
less to him. Also, work-^sample information should be prelsented in a manner which 

Is relevant to. the vocational opportunities in the lojral labor market area. It 
would serve nq purpos„e for work-sample evaluators to recommend areas of training or 
placement which are non-existent in the p.ocal economy. 

11. Although many centers have attempted to develop work samples that elicit speci- 
fic behavioral acts, ngne have been entirely successful. The major factor in this 
Idck of success seems to be that people react differently to different stimuli, *and' 
even to the same stimuli at different time^. What is frustrating to one, individual 
may not be" frustrating to another. Another significant problem is that an individual 
work sample may be non-predlcitive of future behavior. Iti might take many wotk 
samples ^to determine if the client hap a behavioral characteristic, which is a sig- 
nificant ptert of his vocational profile. 

12. Performance on work samples is easier to measure th^n interest and behavior. 
Tha Philadelphia JEVS has developed standardized techniques for scoring the 
performance of work sampl^es. It is easily demonstrated that a string in the 
"Washer Threading"/ sample 1*6 one inch long plus or minus 1/8", or that the "Lock 
Assemble" sample ej-ther works or doesn*t. Thus, client A performs at the 30th, ^50th 
or •99th percentile, and receives a scaled score appropriate to his performance. This 
scaled score reflects his relative standing within the population. 
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13. What is sorely needed is the ability to predict industrial , performance- from 
vork sample Information. This ability remains elusive because of th^ lacK of 
Industrial criteria. A rigorous predictive study relating work sample performance^ 
to Industrial criteria must be done in order to achieve t^s end. ^ 

■ . ^ ■ • - 

14. At least two types of measurement may be used to v^idate behavioral -data-. ^ 
The first is the check Ifst upon whicfi the evaluator can inditate. the occurrence 
of behavior. This system has. obvious drawbacks. Foremost among which is the 
possibility that the event may go unnoticed.. The checklist also has the weakness of 
misinterpretation. For example, that which appears to have been caused by frustra- 
tion", and may, in yeality, be .imputed to hunger or even such problems as poor coor- 
dination. The second method of validating behavioral measurem6rits will be to seek 
the products of the behavior. in the form of completed work samples. Little has been 
done in this area, but it is" conceivable that a man may produce a product which will 
be influenced by his "inrier states". .In our experience, we have all seen products ot 
frustrated workers. Every work sample evaluator has struggled to take apart an 
assembled product after an angry client has taken out Tiis aggression on it. 

15. The problems in assessing interest neatly parallel tho^e of behavior. For 
example, if a man has a particular interest today, what does that predict about his 
future? The questions are: How reliably can you measure what we call vocational 
interest? How stable isv^interest? In work samples, interest is usually measured 
in a subjective manner. There are few among us who would want to abandon the 

•skilled subjective evaluation which invariably occurs during work sample assessment. 
Many claim that such data ate most Important because of their salience in determining 
vocational placement. But can interest be measured reliably , and if so, how can 
this be accomplished? 4 

* - • HAROLD V. KULMAN 



. • SITUATIONAL ASSESSMENT* . . " 

♦ 

1. Situational assessment "is one of the most widely used vocational evaluation 
techniques. However, there is no standard, uniformly Accepted definition for the 
term "situational assessment." Neff (1966^ 1968, 1970, 1971), for example, defines 
the situational approach as being "...aimed at work behavior in general..." rather 
than assessment of ".., specific work skills...". Roberts (1969) and Sankovsky (1969) 
hold a similar view of situational assessment as focused upon tfie work personality 
and work behavior of the indivJLdual. 

2. /Pruitt (1971), on the^ther hand, has defined situational assessment as a . 

"..^ systematic procedure for observing, recording, and interpreting .work behavior.... 
Miller (1968) and the St.udy Group on *Vocational Evalxiation and Work Adjustment 
services (1972) similarly emphasize situational assessment as a systematic observa- 
tion technique. . , * 

: ' • ^ I 

3. Neither of these conceptualizations, however, really seem to provide an 
answer to the question "What is situational assessment?" The best answer to this 
question has been provided by Button and Miller (1972), who base their statement 
on actxial observed situational assessment practices in several r^habilitatioil 
facilities. 

The essence of situational assessment is that the client is placed 
^ in a real (though controlled) work sittiation where, under close 
supervision of. trained evaluators, he works w:^th ather employees 
on contract jobs for real wages. In this setting evaluators can 
observe the client in a variety of situations and analyze and 
interpret his response. For example, tasks assigned to subjects, 
their physical location relative to other workers, the amount 
and style of supervision, level of financial remuneration, and a 
wide variety of other critically significant social and techno- 
logical aspects can be varied,,.. The purpose of such an environ- 
ment is to enable those concerned with evaluation to vary sys- 
' tfematically the elements of the work situation and thus provide 
concrete behavioral evidence of the problems clients have in 
adjusting to work settings.... It is possible'for sensitized 
observers to systematically gather data about client *s perfprmance 
^nd yet^ tljese data are not always used.... Considerably more 
attention is given to the fact that work involves a social as 
well as a technical environment (Button & Miller, 1972, pp. 108-109). 



\ 




There may be "Some minor variations in the actual practice of situational assessment 
In ,individual facilities [for example. Miller (1968) suggests the use of any job 
station. within a facility, not just contract jobs], but the basic elements , of 
situational assessment are included in this statement. * 

4. . It is very easy for some person? to focus upon just the job station and ob-^ 
servational aspects of situational assessment. This ^lakes situational assessment 
appear to be a very cheap and easy approach \^ vocational evaluation: Simply 



*The material in this paper was abridged from Situational Assessment : Models for 
the Future, published by the Research and Training Center. Preparation of this pan^r^ 
was supported, in part, by Grant Number 16-P-56821/5, from the Social and Rehab- ^^'^^j 
ilitation Service, Department of Health, Education, and Welfare, Washington, D.C. . J 
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place the client on any job station and watch wliat happens. In fact, this seems 
to be what passes for situational assessment in a number of rehabilitation facilities. 
•Unfortunately, this ignores the critical element" of situational assessment: the 
systematic variation. of the elements of the work situation. As Button and Miller 
(1972) state, it is this systematic variation of elements that produces the "...con- 
crete behavioral evidence of the problems clients have in adjusting^^^o work 
settings...." • 

5. The elements of the vrork situation have to be identified before they can be 
systematically varied. This is probably the weakest aspect of the current practice 
of sitqational assessment. Many times, the elements of the work situation are 
known oftJi-y to. an individual vocational evaluator; if he leaves his job, this knowl- 
edge goes with him. In other instances, only a portion of the Important elements 
in a work ^itdation have been -identified, making it difficult for the evaluator to 
correctly analyze and interpret the client's .response to the situation. Methods 
need to be developed and used that will insure both that all of the Important ele- 
ments in the work situation have been identified, and that this information is 
recorded in a permanent and systematic manner. Additionally, this identification 
of elements should provi^ a set of observational cues to the evaluator, basically 
Informing him of what he( is to observe, while the client is in the particular work 
, situation. 

■ 6. Any work situation can be analyzed in terms of two major components: the 
'.. technology of the job and the social aspects of the work setting. Objective methods 
for identifying both the tecljnical and social elements of work exist and await only^ 
application to workshop job. stations by vocational evaluators interested in improv- 
ing situational assessment. JOB ANALYSIS is concerned with the technology of the - 
job station. This technique enables the evaluator to identify those worker 
functions and worker traits required for successful performance of the work tasks 
included in the job. BEHAVIOR SETTING ANALYSIS is concerned with the social aspects 
of the job station. This technique enables the evaluator to identify the typical 
patterns of behavior and social interaction which occur, iiy the work setting. These 
two approaches are discussed in the following sections. 

7. Rectent modifications in job analysis techniques h^e led to an emphasis on 
describing the "job-worker situation" in functional terlns (U.S. Department of ( 
Labor, 1970^ 1972). To a gr^at extent, these modif icatioils have overcome a major V, 
deficiency of job analysis: a focus on the job rather thkn the worker (Neff , 1966). ^ 
The first step in the Department of Labor job analysis procedure is to prepare a 
detailed description of all the tasks a worker must performHo complete the j'ob. ■ 
These task, descriptions are written in a standardized format jthat states what the.^.^^ 
worker does, what he does it to, what he ^oes it with, andjrfie purpose for doing 

it. Once this step has been completed, these t^sk-tJsscrilJtions are related to 
standardized descriptions of worker function£and worker traits. This provides 
•the basis for the analysis of the idh in worker related terms. 

8. Worker functions refer to the significant! relationships that a worker has to 
data, people, and feblllgs^uring successful pe/rformance of the job. Any job requires 
a. worker to function in soSk^t elation ship to/data, people, gr things and the hier- 
archies defined for each of thSse three relationships provide a convenient way of 
describing how'the worker functioris on a i6b. Worker, traits refer" to basic functional 
capacities of the worker. The'^traiV^se^ in the Department of Labor job analysis 
approach include general educational deWlopment, aptitudes, intere.sts, temperaments, 
and physical capabilities. A "qualifications profile", indicating those traits a 
worker must possess to successfully perform the job, can be developed by comparing the 
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the task descriptions of the job to the standardized d^inilfiU^ns for each level of 
the specific worjcer traits. * {"^i \ 

9. The use of jolXanalysis- techniques improves the evalu^ioj^s understanding of 

the technology of the job station being used in situational assessment. This directly 
relates to being able to say more about the performance of the client undergoing 
evaluation rather than simply indicating whether the client was successful or unsuc- 
cessful. The use of standardized terminology for worker functions and worker traits 
facilitates communication, as well as enabling the evaluator to link performance *on 
the specific job or jobs used in situational assessment to probable client performance 
on other jobs, iif the world of work requiring the same worker functions and worker 
traits. The improved knowledge of the technological requirements of 4:he joijs, uspd 
for situational assessment, enables the evaluator to better identify specific func- 
tional problem areas the client may have. Additionally, th^ evaluator can Improve 
his utilization of time by scheduling clients on work stations- and his observational 
time in such a way as to avoid extensive duplication of oTjs^rvations and redundancy 
»of performances. | 

10. The behavior setting analysis technique produces a description of the behaviors 
typical of a satisfactdry worker in a ^^^fcific work setting. It enables the ev^uatdr 
to establish relationships between observed client behaviors and controlling factors 
that exist in the physical and social environment of the job station. The concept of 
a "behavior setting" is an exttemely useful one in situational assessment. As 
defined by Shontz (1967), "behavior settings are naturally occurring units of the 

. . .environjueiijrThat include not only behavior but the social and physical contexts 
in which behavior occurs." More specifically, a behavior setting is a combination of 
behavior and a setting that has the following characteristics (Barker, 1968; LeCompte, 
n.d.): ^ » 

1. a recurrent pattern of behavior. 

2. a part;icular combination of physical and environmental ^ 
characteristics. 

3. a specific time and place ^ 

4. a relationship between the behavior pattern and the 
* characteristics of the setting. 

A job station within a workshop generally meets the characteristics of a behavior 
setting. However, there are a number of other behavior settings within a workshop 
(e.g., cafeteria, lounge area, counseling office,* etc.). A complete analysis of 
the behavior settings in a workshop would include these areas. 

11. The behavior setting analysis details each of the characteristics of a behavior 
setting as they aphly to a specific Job station. The recurrent pattern of behavior is 
determined by/observing tM behaviors engaged in by a satisfactory worker on the job, 
and determining theVgEC^tage of time the worker engages in each behavior. Several 
methods can be used to obtain these time estimates (e.g., Button, et al, 1968; 
Peter, 1972). However, one simple method is to use one or more stop watches to 
record tot^l elapsed time spent in each behavior during a series of^^observations 
randomly, ipterspersed over the-course of a working day. 

12. Lustig (1970) has indicated that the physical and environmental characteristics 
of a work setting can be divided into five components; (1) the rules and customs^ 
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for the job;'. (2) the worlA task; (3) the social and interpersonal situation; (4) the 
physical environment; and\(5) the worker hlmsr^rf . The analysis of the work task has 
been discussed in relationXto job analysis. Additionally, since the purpose of 
vocational evaluation is to describe the client (or worker) in relation to other 
components of *the work sit/uation, the analysis of the physical, and environmental 
characteristics oY the work sta^tion focuses upon the rules and customs, social 
interactions, and physical egvironmeit "of the job station. 

s 

13 The rules and customs of work are primarily established on a f acility*4d.de 
basis. Specific work stations,, however, may have some unique rules &nd customs. 
Hair nets may be required on job stations involving moving machinery, but not on 
assembly or packaging jol? stations. It may be customary 'to allow workers in sales 
job stations to take rest breaks when customer flow permits, but to confine the 
rest, breaks of wbrkers on a production line to a specific time period when the 
entire'line stops. Both the formal work rules arid the .accepted customs of the job 
station are observed and recorded in the analysis of the behavior setting. 

14. The most complex area of analysis has to do with the social and interpersonal 
situation. There are so many possibilities that it is difficult to develop a com- 
plete taxonomy of possible interactions. Attention has to be given to those that 
occur with some frequency and regularity, with particular attention paid to the man- 
ner in which interactions are initiated, and the purpose for the interaction. 
Similarly, some attempt has to be made to identify some of the significant char- 
acteristics of persons the worker must interact with. This includes characteris- 
tics of co-workers as well as those of supervisors. 

15. The physical environment surrounding the job ^'includes space, area, temperature, 
light, sound, equipment, machines, a^nd tools (Lustig, 1970)." These factors are 
readily described, and some are included in. the job analysis schedule for the work 
task. Particular attention is given to the position of ihe worker relative to 
other workers <Lustlg, 1970). This includes workers ordinarily in proximity 

to the job station, as. well as the^ location of the job station, in relation to 
traffic aisles. 

16. When the behavior setting analysis is focused upon a job station, time and place 
are' readily described by the working hours and departmental location of the job. 
Some jobs, however, may occur infrequently, while other behaviors of interest to 

the evaluator may occur only, on a once per day basis in a particular location, 
(fbr example, coming to work on time). These need to be specified. ' ^ 

17. An essential quality of a behavior setting is that the behavior pattern is ' 
linked to the characteristics of the setting. For the most part, these links are 
apparent once both the behavior pattern and the characteristics of the envir9nment 
are identified. There are occasions, however, where these links are subtle and 
involve interactions among several characteristics of the work setting. This re- 
quires very careful anal^is, and a thorough understanding of the total work situation. 

18. The application of job analysis and behavior setting analysis techniques to 
workshop job stations,^ used for situational assessment, is a basic step in making 
the job station into a "standardized situational^ As Brandt (1972) uses the term, 
standardized situations ". . .occui; and recur regularly enough to be ideal for 
measuring. . .behavior or performance under .relatively standardized conditions." 
The advantage^f the standardized situation is that "...comparisons can bp made 
among peopleCaerely by tallying and tabulating responses made in the same basic 
situation (Brandt, 1972)," , ^ 
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19. ^ The standardized situation approach to situational assessment enables the 
vocational evaluator to make maxlrtum use of available job stations. In particular, 
it enables the evaluator to introduce the systematic variations of job elements 

^ that are the crucial component of situational assessment in two 4<ays, First, the ^ 
evaluator can select specific job stations for use in ^evaluating a client on^'the . 
'basis that the job station contains an element of interest. This approach does not 
require the evaluator to manipulate the job station, rather he schedules himself to 
make observations of client performance or behavior when the crucial element occurs. 
Second, the evaluator can manipulate a particular job element in a work station to 
observe the effects on client performance or behavior. Since work station elements 
and their^ effects on behavior are identified, the evaluator is -usually in a position 
to predict the probable effects of variatiourcyf an element. 

* • 

20. Once the facility or workshop has developed a substantial nui^er of its work 
stations into standardized situations for use in situational assessment, the 
performance and behavior of the client in evaluation can be more precisely identi- 
fied across time and situations, u/ing "recurrent pattern analysis (Brandt, 1972)." 
A series of observations of client performance and behavior, made in situations with 
known characteristics, are analyzed by examining the rate and frequency of occurrence 
of specific performances and behaviors in similar situations. The recurring 
pattern analysis technique is useful for separating behaviors into those that are 
characteristic of tlie individual, in any work situation, from those that are controlled 
by speeific environmental factors, and those that represent unique responses of the 
individual to particular settings. ' , 

21. As the era of accountability and program eyaluation progress, both vocational 
evaluators and facility administrators will have to provide adequate documentation 
of their efforts, and the results of their efforts. Situational assessment has been 
one of the. grey areas of vocational evaluation. To establish. and operate^ a situational 
assessment program, using available technology, requires considerable expenditures 

of time, effort, and money. The payoff of these expenditures is that the situational 
assessment approach to evaluation leads to more Adequate accountability in terms 
of the accuracy and utility of information gained and conveyed to both the client 
and referring counselor. The basic question confronting administrators and eval- 
uators at this time is whether they want to make the necessary investments in 
situational assessment. 

DENNIS j; DUNN 
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THE EVAUJATOR AS THE SYriTHESIZOR - ■ 

1. The role of the evaluatoi^^s been described as that of the syntheslzor of in- 
formation from a variety of sources into an integrated concept ~ .this concept being — 
"the client As vorker". In relating this view of the evaluator to vocational evalua- 
tion as a whole within the fraipework of this VEWAA project, it quickly becomes obvious 
that the evaluator himself, in terms of his knowledge and skills, training and indi- 
vidual capacities and responsibilities, is central. How he functions as a person; 

how he relates to the sources of information, be they 'peer, professionals, tests, ' 
employers, reports or whatever; and how he deals with this' infonnat^-on is Important^. 
Is the evaluator a generalist dealing with all information, or a specialist contrib- 
uting specific information? Hence, although this topic falls under "The iValuator^s 
Tools", since in a sense the evaluator himself. is a tool, it also relates directly to 
"The Evaluator'*. 

2. Beyond this, sources of information about a client's vocational functioning, and 
the ^isformation to synthesized by the evaluator, can be considered "tools" and are ' 
points of emphasis. Most of the sources of information are human^ interpreters of the 
client's functioning or his physical state, and the evaluator 's effectiveness depends 
not only on his understanding odr^EBfeir work, but also on his relationship with these 
people. Hence "humdn dynamics" in^ocational evaluation is an integral part of this 
topic. Since the client himself is the ultimate source of all, information,^ and it - 
is assumed that the evaluator will continually check this information with the needs 
of the client, this topic is also closely related to "Client ^Participation in Evalua- 
tion." Hopefully, the client functions as a partner or co-syuthesi^ior in the syn- 
thesizing process.' v . ' 

3. Literature Review . In reviewing the literature concerning the role, of evaluator ^ 
as 8ynthesizor,one is quickly struck by its similarity to the literature of a decade • 
or 80 ago, and continuing to the present, regarding the definition of tiie role oi the 
rehabilitation counselor. The question common to both is: Is the counselor/evaluator 
a generalist with working knowledge of all professions relating "to man ap worker, or 
is he a specialist with specific skills and ^responsibilities functionliig on a team 

of specialists? For example > "he learns to recognize the basic principles involved 
in medicine and psychiatry, psychology, sociology, social work,. law, educatibn, and 
other fields. (and) he is able to draw from these fields whatever ipforpiation is ' 
available and interpret this information in terms of vocational objectives"' (Johnston, 
1960). This was one view of the Rehabilitation Counselor, circa 1960;- it wo\ild seem * 
to apply directly to the view of the evaluator as generalist/ synthesizor. thus,*' the 
outcome of the long-term coordinator ve^rsus counselor controversy ^within- the field .of 
rehabilitation counseling, may have some parallels in the generalistic versus special-* 
ists question with the field of evaluation. At presjpnt, there a^ppear tio be both • 
specialist counselors and generalistic coordinators of services. 

4. Hoffman (1969) observes "with vocational evluation involving the evaluation for 
medical, psychological, vocational, educational, cultujrA, social factors, and en- 
vironmental factors a variety of professional persons are involved". He discusses 
the value of a staff who come fr^m a variety of sources, le.g., occupational therapist, 
foremeiKin industry, psychologists., rehabilitation counselors, and industrial, arts, 
and sugg^ts that vocational evaluation be conducted in one comprehensive facility ^ 
under the team approach, or through referral to separate professionals or facilities. 
He also Sugg^ests-.that one individual, "such as a rehabilitation counselor" be a "co- 
ordinator" >f the whole process. Dautermann (1964) is representative of the -view 

> of the evaluator as "one more specialist" whose functions are to assist the client 
' to evaluate himself, and to provide rehabilitation workers with information about 
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the client's performance, Lustig is quoted (Hoffidan, 1969) a6 distingaishing between 
the "work' evalua tor", who functions as a work evaluation specialist, and the "voca- 
t&naL cvalTiator", who ia a sort of vocational Renaissance man competent in all . .* * 
vocationally related areas and, therefore, non-existent. 

. -> * 

5. Many sources of informaticy^ pertinent to the evaluation of a client's voca- 
tional functioning and potential, and hence pettinent to ''the evaluator as sjm- 
thesizor", are found in the literature. N6t unexpectedly, many of the articles 
t)dinting out the, importance of a specific source of information, e.g., medical, . 
ate written by wc^rkers in that area, e.g., physician, occupational therapist-. 
For example, a study indicating that the specific vocational objectives of 47% of 
a 'sample 110 clients, wer^ directly influenced by a medical opinion, was written, 
by medical professionals (Gorthy, et al, 1959). The holistic viewpoint in evalua- 
tion is pervasive through the literature. For example "...we cannot isolate vocation 
a^work from the rest of living... One works ^only during certain portions of one's 
living tdtae. The rest of the time one is doing all sorts^ of things wliidK have pro- 
found bearing on how effectively one works" (Cobb, 1967). Among the -vocationally 
relevant sources of information mentioned in the literature, McAlees' (1967) summary . 
iaj representative: 1) work history, 2) educational and soqial data, 3) client and 
family interviews, 4) medical and psychiatric consultation, 5) psychological testing, 

'6) work stoples,, 7) workshop evaluation, 8), part-time or t^porary work, 9) behavior 
observational methods, e.g., role playing job interviews, 10) on-the-job training 
experience^ and, 11) case conference. If indeed the information from these varied 
sources are, the raw material upon which the worker/synthesizor 'operates, the worker who 
synthesizes this data must be both knowledgeable and capable of a high ^evel of abstract 
thought and concept formation. . . ^ 

6. * Sources of information relevant to the evaluator can be divided into those that 
are directly under his control and Immediate ^perience, and those which are not.* Thus 
far, we have discussed synthesizing information from a variety of disciplines, and thus, 
the ^ynthesizor as^'a generalist. However, the literature also deals with the synthesis 
of information gathered by the evaluator with the to6ls at his disposal, .and henc^ with 
,the role of the evaluator as a specialist. ' The evaluator as synthesizor determines ' 
what types of behavior are relevant with what types of clients, and how to weight these 
data in terms of their, relative^ importance in describing "the client as worker"^ and 
predicting his, vocational potential. He selects pertinent data from behavioral obser- 
vations of work habits and supervisory Relationships; work sample and testing scores 
and behaviors; ^ork readiness factors such as attendance and punctuality; hygiene, etc. 
CoBb (1967) In writing about the mentally retarded suggests, five major areas to be 
synthesized: 1) personal factors, self -concept, etc.; 2) self -management ~ of the 
everyday affairs of life; 3) interpersonal relationships — close hinnan relationships; 

4) interpersonal-social transactions — social role to role, as employee to boss; and 

5) productive behavior*— job skills of all kinds. The weighing of information as 
its relative importance is individual with each specific client. Attempts have been 
made to gather information and develop predictive scores from several disciplines, and 
to combine these scores into a composite score, which would be us^d for predicting vo- 
cational success, e.g., ^ue and Moed (1960). Biit for, many reasons, including' the 

^ large number of ^unknowns and situational variables, and unrefined techniques, eval- 
uat^ions based specifically on statistical results have had little ^phasis. As eval- 
uation tools and sources of information become more refined, the vast literature of 
Jpiatistical versus clinical prediction will. becMe more relevant. Unless, as Dunn 
• ^1969) suggests,, evaluation is essentially a ppbcess of "under stand irig" rather than 
'"predicting.". . ^ ' . x/ . 

7» Personal Observations . Prom thi's writer's point of view, A^teata apprdach to evalr ' 
. uatlon is most effective, so long as there Is close communication between team members, 
and as long'as one team member is responsible for the coordination of activities and 
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synthesizing specific recoramendationsA The variety of input regarding a client, from 
rehabilitation workers of ^l^fferent buCi work-relevant backgrounds and training, is 
valuable/ Basic to the whole process, however, is the client^s role and responsi- 
bility in his own evaluation! his experience, learning and internalization his ^ 
synthesis ~ of the results, is the most meaningful aspect of evaluation for his 
overall rehabilitation and Ufe adiustment. I'he role of synthesizor of information 
thus falls upon-the worker, who is most conversant with the variety of information 
sources, but most importantly, who best understands the client; This depends on the ^ 
agfency, and can be the counselor, the work evaluator, the psychologist, or whomever. . 
No one field thus far has been given s^pthesizing, responsibilities, and, perhaps / 
this point iri the dev'elopment of rehabilitation worker roles and responsibilities, 
this is fortunate. ' "^-^ ^ 

3. The. training, knowledge, and skills of the evaluator undoubtedly imluence his 
assigned responsibilities in the evaluation process in a specific settlh^. Usually 
the generalist as the synthesizor of information is academically trained, often with 
' graduate experience. His training may have :included a familiarization with other 
professions, assessment methods, human behavior, etc., and he is thus ptobably 
familiar with most' information. ^'sources. He has been judged on thought ana concept 
formation, and has been. required to write papers and integrate in^ormatiph from broad 
sources. But in some settings- this -training and background may not be Ifhe most 
appropriate for the role of wprk evaluator, or to fill out the needs atid gaps in 
a specific evaluation team. The mature work evaluator, for example, With broad work 
experience in a variety of job settings,, but with little or no academic preparation 
beyond high schoo^^ level, has a great deal of realistic job informati(ra and may be 
most appropriate for the team. In this writer ^s experience, a number a£~^aluators 
falling into this category function well as evaluators, especially in a specialist 
role, with the assigned responsibility of contributing information on "the client 
as workerV to tlie.team. Another team member, such as the evaluation counselor, may 
then function as generalist 'and. overall synthesizor .of technical infonpatipn from 
other professions and. sources. On a team, a balance of academic with broad vocational 
backgrounds can be useful, since both backgrounds provide experiences and insight^ 
which can be highly valuable to a client's understanding o£ himself as potential worker. 

9. The concept of "synthesizing" entails the gathering together of pertinent infor- 
mation into an integrated concept a whole ~ in this case "the client as worker". 
The evaluator must.be careful that it does not also imply a static concept, a^con- 
crete description; evaluation is a process which requires constant or a least 
periodic feedback, and the evaluatbr must be ready to resynthesize, to update his 
.concept of the client^ to be ready and flexible enough to take in and accept new, 
infqrmation as it is found, or as the client changes. The danger of stereotyping 
clients, or categorizing them based. on similarities, to otfher previous clients, is^ also 
-a problem of the synthesizor, whether he is functioning as a generalist or specialist. 
* The dangers of static concepts and stereotyping can be met by giving the client respon- 
sibility in the evaluation for synthesizing and internalizing information about himself. 
Another area of concern involves the .human dynamics in the evaluator *s relationships ' . 
[ with other rehabilitation workers. If his background and training are significantly 
different from the other workers, he may experience problems in communicating his view 
of the client. This may be especially so if the work ^evaluator is interpreting ob- 
served .behavior in terms of the reality of the work supervisor , .while his co-workers 
consider themselves working with underlying motivation to that behavior. In any ca$e, 
the evaluator *s skills at working with people are critical,1both in gathering ajid in- 
terpreting data, from and to clients, and peer professionals. \ 

lOp Information from a variety of sources must be considered in the evaluation of a 
client. While the evaluator may, in many cases, function as a specialist, he must be cog- 
' nizant of how to use information from other disciplines in understanding his client. He 
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must also have a clear 'understanding of the role of a worker in a variety of job 
settings, so that he can determine not only what informatipn is pertinent, but also for 
what jobs certain tjrpes of information are more Important than others. For example, 
for the jobs of assembly-line workers, salesmen, or draftsman different types of in- 
formation, e.g., social skilis-^nd dexterity, are pertinent, and are weighted differ- 
ently as to their importance in the p^formance of the job. Thus, the evalbator as 
synthesizor, especially if Jie is functioning as a ger\eralist,* must be conversant 
with information from the variety of sources (noted in McAlees summary in pajragraph 
5 above). It, may be that it is more important to the team that the work evaluator 
be familiar with the characteristics and demands of jobs than^that he be highly knowledger- 
able of the specific information and data developed by other profession's and sources. 

11. Information from other professions, conveyed in reports, tends to^ be treated ^ 
more concretely, and is less susceptible to updating, than information presented by 
another team member. Medical reports describing disability; social histories defining 
peer and family relationships; psychological testing reports; and educational transcripts 
are "givens". which set the limits for planning. Information from team members, includ- 
ing the above professions, which is conveyed via discussion and interpretation, rather 
than in reports, can become more viable as it is updated with the client's progress. 
Information concerning the client's behavior and motivations receives much attention 
because of its changing, non-static nature. With many clienBs, specific "vocational" 
data are not emphasized until sometime after th^y have entered the evaluation program, 
because of the emotional and behavioral problems concomitant with adjusting to the aew 
setting. The program this writer is associated with is a residential facility and be- 
havior, in the residence during xion-work hours receives major emphasis in staffing and 
vocational planning. Hence, while the information from other professions and disciplines 
provides the backgrotod for a client, and botb sets the limits and engenders hypoth4ses 
about the client's potential, the client's behavioral functioning at the evaluation 
facility provides the information whicli may be most salient to his vocational planning. 
Indeed, some evaluation workers initially do not read repotts describing the client as 

he was b^efore he entered the evaluation program, .because t]iey believe .that it gives 
them preconception about the 'client, and interferes with their getting to know him "as 
he actually is". . * . 

12. Theory as it Relates to Practice . The theoretical underpinnings of the evaluator 
as synthesizor are scarce in the literature,. Areas relevant to theoretical treatment 
would include the responsibilities and role of the evaluator in relation to other 
members of the rehabilitation te^m; the evaluator as generalist versus specialist; 
background and training of* evalufittors; cjinlckl versus statistical (or subjective 
versus objective) synthesis, and prediction; ^nd participation of client as co-sjm- 
thesizor. Perhaps the most crucial need is to define the role of evaluation and the 
evaluator in terms of their place within a theoretical model of rehabilitation. In 
theory, rehabilitation and evaluation are "coterminous processes" with evaluation con- 
tinuing even after job placement and until the client is functioning at his highest level 
on an appropriate job (Gellman, 1968). Thus, while the process of eyaluation is continu- 
ous by the client, different rehabilitation workers may be responsible for the updating 
and res3mthe8izing during different phases of the rehabilitation pi^ogram. If one 
rehabilitation worker works with the client throughout the process, this worker then 
might best play the role of generalist synthesizor. The' work evaluator 's role' is 
usually more circumscribed and functions during the initial phases of the rehabilita- 
tion process. Ke heiM formulate the initial decisions and predictions, but both 
practice and research indicate that predictions in rehabilitation are most valid for 

the next step in the re^iabilitation plan, and become decreasingly valid as the client 
progresses through his rehabilitation program. 



ERIC 



13. The theoretical view of man as a holistjlc being, who cannot be partitioned 
'without losing his ess^ence, demands he be viewed from all directions and dimensions 
to be understood* No one worker has all the knowledge and skills to provide all 
rehabilitation services*. Theoretically, a team of specialists, whose training 
and background supplement each other, which includes the client, and with one worker 
being responsible to coordinate and synthesize the process, would be both necessary 
and ideal* In practice, the human dynamics involved in team functioning can become 
extremely complex and communication lines can tangle hopelessly* Diversity of back- 
ground and traiM.ng can lead to confrontations of philosophy and, approach rather 
than an enriched! awareness of the client* The synthesizor may thus be working with 
inadequate or incomplete information* Hence, a team must deal openly' with any prob- 
lems in communicant ions and work together, in order for it and* synthesizor to 
work effectively^ The synthesizor must be closely attuned to and a^are of the elient, 
as well as information about him, in?order to adequately synthesize a. concept erf the^ 
"client as worker". 

14* Within a theoretical model of rehabilitation, training for the evaluation |ector 
should supplement^ but not duplicate training for. other sectors, although enough over- 
lap should exist to promote communication between workers* Training programs are 
probably not broad enough at this time to train the generalist adequately (Hoffman, 
1969)* As the profession and the tools for evaluation develop and refine, and as the 
evaluator becomes, responsible for assessment in greater ^iepth and finer precision and 
validity, his roLe may well become more and more that of specialist* The use of compu- * 
ter data aS ^statistical anlysis, which at this ^e are mainly of research and theore- 
tical inter*t in, the field, may become considerably ihore relevant; as methods of measure 
ment and qualification are found for many of the variables thus far not accessible to 
measurementTwnile it is theorized that evaluation is an ongoing process with con- 
tinual feedback and change, in practice workers are not always open to revising their 
conceptions tf clients* Clients are sometimes quickly categorized and considerable 
change on their part is required before a worker resynthesizes hig concfept^of that' 
client.* In gSftral, theory may posit the goal or the ideal toward which the field, 
is striving, but !has not yet reached* The theoretical aspects of this topic, are still 
being formulated; * * ' 

15. Questions to be Answered * The questions t^iat need to be dealt with to define 
the topic of the evaluator as synthesizor focus on the evaluator himself, his back- 

. ground and training, information* he deals with, and the goals and effectiveness of 
the synthesized concepts of the "client as worker^*' A major question is, Who is 
the synthesizor? L Who has the responsibility for synthesizing information in evalua- 

.tion-and rehabilitation? Whould this re^onsibility be defined and limited to one 
discipline?. For ^example, should the synthesizqr be the worker v^o subjectively best 
understands the ^lient, or an object ive'^^bserver of his behavior? 

16. A recurring, theme in this paper revolves around the roles of generalist or special- 
ist in the synthesizing process. The questions to be asked are; Is the ^svnthesizor *s 
role that of the 'generalist? Is the evaluatorfs role thajt^of the generalist or the ^ 
specialist? The^- generalist sjmthesizes information from^a variety of sources and 
disciplines, while the .specialist synthesizes information gathered primarily from ' 

his own tools an^ observations. Where is the evaluator on the continuum' between / 
specialist and generalist? At either extreme? Near the middle? How well' does the 
evaluator understnad 'medical, psychological and social data? A question related to * 
this is: How does the evaluator 's background and training influence hie potential 
role as synthesizor of information? The questions regarding what type of background 
±e most appropriate for the ev£^luator, and what knowledge and skills does the synthe- 
sizor need, are germane. 
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17. Central to this topic and in need of more attention i^ the question: t\Tiat 
sources and types of information are most relevant and useful for vocational eval- * 
uation? Does the evaluator 6t ev^luatioil team concern, itself, primarily ^Jith- 

specific job information? Does ,it brbaden its focus to include kindred professions? 

Does it expand further to include family and community living data for synthesis? 

Can't a generalization be made* a^toAhich d^ta sources are mo^t relevant, pr . " 

is this individual to each clien^ /Ai^lmllaf and related question in>olyes the 

theoretical view of rehal^i^itat;ior^^Wk holistic process involving the whole 

person. Does Vocational evaluation' \Zso need to be a holistic process or can 

jgrk-related variables be isolated /^th 1ft tie need to synthesize non-job 

^riables? . * * j.. ' 

18. Dire'ctly relevant to the* above problems areithese final questions. First, 
What are the goals and P^poses for which evalu'atiion' data are summarized? More 
specifically. Is the gpal>f the synthesis of information in evaluation essentially ^ \ 
a process of understanding o^. predicting? Synthesizing information for the purpose 

of understanding a client — ahd helping him understand himself and developing 
treatment plans to facilitate hrs growth^^-^-'-Tftay^ well be somewhat different froiSevalua- 
ting a client primarily for the^^urpose of .predicting his potential for various train- 
ing programs or jobs. Finally, Including 'Vhe client in his evaluation is generally 
considered a positive practice. In^this wrIter*'^MJpIh4on, the inaj or 'lasting gains ■ 
atd insights derived from thfe evaluation escperience are those made by the client. 
He should be given as much responsibility in the evaluation process as he can * 
handle. Realizing that this m^ va'ry with each client, the' questions are: To 
what degree should the client participate as co-synthesizor in his evaluation? How 
may client participation *and rest)onsibility be facilitated? 

19. Challenge . By this time the challenge to the forum should be clear,. even if 
the topic is not. The evaluator *s role and' Ais tools are still in the process of 
evolving, and need definition, so that futup^ efforts at evaluator training and d^evelop- . 
merit may be planned and guided rather than sporadic and haphazard. Wasteful dupli- ^ 
cation of efforts with other disciplines can be avoided, while the gaps in evaluation 
services can be identified and dealt with. When evaluators have a clearer under- 
standing of their responsibilities in the synthesizing of information, and of the 
value. of various types of information, more effective functioning can be expected. 

An^, if jevaluators do not clarify this area, someone els?Vill undoubtedly structure 
their responsibility for them. - / 

20. "TThat in essence has been discussed in this paper is the , extremely delicate re- 
sponsibility involved when one man/attempts %o understand and uiake decisionfe||t7ith/f or 
another, and especially since this under-standing may critically influence life adjust- 
ment. It has been suggested that the. client has not only the right/ but the responsibility 
to participate in his own evaluation. . The Imperative for t"he worker is that 7i? develop 
his skills and his Jsensitivities to his client *s interest, so that both the man and his 
society benefit. Intrinsic to the topic is man*s relationship to rngtv, without a himianistic 
framework. The challenge thus becomes to define this topic creatively, and with sensi- 
tivity, to the needs 6f the people served. * , . ^ 
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" BUILDING NEW SELF-CONCEPTS IN THE CLIENT . 51, 

!♦ If' there is a cotnmpnality among clients seen in vocational evaluation, regardless 
of the evaluation setting, the disability of the clients or the geographical region 
in which they live, it is that of repeated personal failure^* It is my contet^tioft 
that any given series of personal or environmental failures can affect a client s 
self-conc^t to'^point where he questions whether he is personally equipped to meet, 
the compllxities of the society in which he finds himself existing, Johrt Holt, in 
his book, flow Children Fail , suggests tha^ most children in school fail,. For a 
great ^ny, this failure is avowed and absolute. He states that close to 40% of^ . 
those childr:en that begin hi^ school drop out before thl&y finish; college dropouts 
average one W of three. Many others fall in fact, if not, in name. They complete 
their schooling because we have agreed to push them up through the grades and out 
of the 9chools, whether they knojj anything or not". There are many more of these 
children than we dare to thinlC, He also goes on to say that except for a handful 
pf children who may- or may not be good students, ^ach failed to develop more «than a 
tiny part of fheir tremendous capacity for learning, understanding, and creating. 
If we consider Holt*s thoughts, we can well-understand why the .contoon trend of 
failure runs consistently through those clients seen in a vocat^jOnal evaluation 
program. The pattern of failure is engraved early in the lives o^ many of the clients ^ 
seen in vocational eyalu&tion,^ on^ failing experience built upon another, until it 
is difficult for them to summon the mental and physical energies necessary to bring 
about a success, .Vocational counselors often refer to clients as ieing non-motivated, 
because th^y have failed to meet some responsibility ^et for them by the counselor 
in the rehabilitation process, I' subm^it that' many of these clients are, in actuality, 
motivated, but do not have the personal self-concept needed to meet these externally 
set responsibilities r - * ' 

2, The vocational evaluation process, in my .opinion, can often provide the client with 
insights into his personal considerations and abilities, thus allow^ him an opportunity 
to 'call upon the internal energies necessary , to meet, external responsibilities. For 
the evaluation experience to be a meaningful, relevant, and profitable experience for 
a client, it must be looked at in a more comptehensive framework than. that of just 
putting a clienSi through an "evaluat£t)n system" that will provide the vocational 
counselor with information about the client *s ability to be emplo^fc4^r trained in a 
particular area. Too often, vocational evaluation programs are estabxl^hed in^reha- 
. bilitation, centers by naive administrators, who feel that clients can be evaluated by 
existing evaluation systems, regardlessr of the ability of the vocational evaluator s; 
and that this information will equip the vocatioijal counselor with fifll the necessary 
data he* needs to place his client in an^ appropriate job or training slot. There is 
a basic error of judgment in this proposition. If the vocational evaluation unit 
is not manned by vocational evaluators, who ' Excellent clinicians with an ability 
and- an established philosophy for working with.^ople, then no existing evaluation 
system is capable of providing the necessary data for the vocational counselor. If ^ 
Ve accept the proposition that the vocational evaluation process forms the^f oundational 
information for a vocatlortpl counselor move his client through the rehabilitation 
process, then we must also accept the proposition that a client must experience success 
in the evaluation process. The equipping of a client with insight^ into his own strengths 
and weaknesses, through the use of a ^iety of experiential tools, including work 
samples, psychological* tests, situati^al assessments, on-sigh^assessments, etc, then 
becomes the essence of the evaluators unique contribution to the rehabilitation process. 
The evaluator must stand steadfast ~ one foot planted firmly in the realities of an ever 
changing competitive labor mark*fet, witlj the other placed in the therapies that will 
ultimately bring his client to a point where he can, with 9 relative degree of assured- 
ness, re-enter th^t labor jnarkdt and^ expect to be sufccessful. As simply stated as 
possible, tfa^ vocational eValu^J'ion process srhould have as its main goal the ^eduction, 
of client failure,. The establishment of a vocational evaluation setting that embodies 
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a philosophy, and the manpower capability of meeting this goal is an extremely difficult 
task. 

3, There have beeit many articles written both in the area of rehabilitation .and in allied 
^ ^i^lds on the client* s§lf-concept. Few of them have established, however, any direct- 

course of afetion of how to set up a program that wolild facilitate building or rebuilding 
of a client self-concept. Rehabilitation has traditionally relied upon the 'remedial 
programs, including shedtered workshops, to meet this need. However, it is clear, from 
the writings at this point in time, that we have not begun to uffderstand the" complexity 
of re-^-estabUshing or redirecting clients' self-concept or internal motivation, \ sub- 
fait that a well-planned evaluation unit in many cases can statt the client along tlie 
"toad to meetipg.vthis objective, 

4, It lis critical to the development of str^h a unit that the evaluative process have ' 
an underlying, philosophical foundation that? will facilitate insight to his own strengths 
and weaknesses. There are* many in the fielcPart this time who would argue that the 

^ evaluator should be an objective, non-involved observer in the evaluation process; how- 
ever, I submit that a well defined program, with a properly educated evaluator, who has 
clear insights into the philosophy of the evaluation unit, has ;.ittle difficulty in meet- 
ing several roles other than a merely passive observer of the client behavior, or a tech- 
nician who records percentiles from a particular test. The evaluator, in most instances, 
. must move in .and put of a ^iety of roles during the evaluation process so that his 
' client can meet his personal objectives and gain insight into his unique strengths an^ 
weaknesses. TJie evalua^tion process is not an end in itself; it is the first step 
back to self awareness and personal insight for the client. Without this first step, 
the establishment of a solid foundation for all the other endeavors in the rehabilitation 
process, his frustrations will ?urely be increased, and the chances for ultimate success . 
will be greatly diminished, I submit to the readers of^thi^ paper that underlying the 
principles of vocational evaluation, and the establ4.shment of a vocational evaluation 
unit, regardless of the physical setting, should be many of the concepts embraced in 
the area of Gestalt psychology. Let us, for a moment, look at the two concepts for tiie 
purpose of identifying those similarities that would be useful in developing an operational 
philosophy that would facilitate the rebuilding of an individual's self-concept. 

GESTALTIST CONCEPTS 

5, Although Gestalt psychology is largely a theory of perception, some attempt has 
been made to apply the principles to psychotherapy. The objectives of treatment or * 
working with people according to Pearls, Hefferline, and Goodman is to overcome the 
fragmentations of feelings, thinking, and acting which are so characteristic of our 
culture^ and replace it with a holistic unitary outlook on life. This can be done, they sj 
claim, by encouraging a more flexible relationship between the individual and his en- 
vironment, or in Gestalt terrife between figure and for&round. It is also clear that 
Gestalt therapy is a basically humanistic, existentiai\herapy . The general approach 
requires that the therapist direct the client's awareness, so that the client experiences 
himself as he is, not as he would like to be, 'or who he thinks he shbuld be, but how he 

is. Through this awareness, he experiences how he expresses his^ feelings, how he blocks 
those feelings and, often, hot/ he defeats himself. Once he has awareness of this' behavior, 
the , individual dan begin experimenting with himself an^. changes begin to occur. The 
goal of the Gestaltist is integration of self. This goal is accomplish^ by supporting 
the individual's genuine interests, needs and desires. 

VOCATIONAL EVALUATION 

6* Vocational, evaluation is the process of assfessin^ and" predicting work behavior and 
wprk potential through* th^ application of reality .based assessment techniques and pro- ^ 
oedures. Although potential employment is of concern to the vocational evaluator an'^ 
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his' client, the goal of evaluation is more than that of a job. Also of importance, 
is the awareness of an individual's strengths and weaknesses, the manner in which 
they are manifested , and their effect on the individual's life. Although the terminology 
differs, I believe, that there are many overlapping viewpoints .in iihilosophy of the 
Gestaltist and the Vocational Evaluator. Both approaches are existential in nature. 
Nadolsky (1971) states that Vocational Evaluation is concerned withthe individual in 
relationship to his environment. Simkins eibphasizes that the Gestalt therapy is concerned 
with interaction in the present ongoing situations. Both approaches have a goal— an 
individual who is self-supporting (doing things for himself which he is capable of doing) 
and self-fulfiiling^ In order to more fully understand the similarities of the two 
approaches, I have outlined the approaches of each for your examination. 



a. 



b.' 



d. 



e. 



f. 



i 
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™erabeutic process of 
gestalt therapy 



PROCESS OF VOCATIONAL 
EVALUATION 



The therapist is an observer 
of the here and now behavior 
of the individual (posture, 
voice, gesture's,' etc.) 



The therapist assists the 
individual in maintaining his 
awareness -of himself. 



The therapist is the director 
of awareness experiments (in 
trying on new behavior, mak- 
ing feelings explicit). 

The therapist provides frus- 
tration and support in - 
balanced amounts whenever 
appro4)riate. 

The therapist is concerned 
that the individual become 
.active and responsible for 
his behavior. Responsibility 
(respqnse-ability, abi-lity to 
respond) for oneself cannot 
be forced. Responsibility is 
not a choice, but a fact of 
'life which a person may or ■ 
may not accept. 

The goal of.thertfpy IS; to 
help a mature person move 
from environmental support to 
self-support. He may be 
descrsfifed in Maslow's terms 
as a self-actualizing in- 
dividual. 



a. 



b. 



c. 



d. 



e. 



The evaluator is an observer of the client's 
capabilities, aptitudes, 'attitudes, and 
tnterests. H^may use pefsonal obser- 
vations, psmiOmetric tests, work samples, 
situatiorial assessmeatSi as well as other, 
tools, to gain. this infonKation. ^ 



The evaluator shares his knowledge with the 
client. iis it'pertains 'to the client's 
strengtKs^nd weaknesses, the way in which 
they ar^ fhanifested, andHheir possible 
vocational implications. 

The evaluator may present the client with 
uhfatniHar tasks or human interactional 
situations in order to observe the client's 
manner of reacting and coping, as well as 
giving the client an opportunity to try out 
new^situatiofis or activities. 

The evaluator may provide frustration -and 
support in a balanced manner whenever 
appropriate. 



Onc€ a clien^ is aware of his alternatives, 
he alone makes a choice as to what he wishes 
to pursue vocationally or in any other area. 
The client exercises choice and has the 
ultimate responsibility for the consequences 
of his action. ^ 

The goal of vocational evaluation (the 
rehabilitation process) is a self-support- 
ing individual, who is aware of his strengths 
and weaknesses, and, who seeks to enhancer his 
life> through productive work or meaningful 
activities. 
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7. Thus, the process of vocational evaluatioa and Gestalt therapy are similar. Both 
the evaluator and the therapist are directive and active, as opposed to non-directive 
and passive, in working vith their clients. Both disciplines rely heavily on setting up 
experimental situations that will allow the client to explore his strengths and weak- 
nesses, so that he may gain greater insight into how he can best function in' our society. 
Both concepts also involve a model choice, and each has as its goal a responsible, self- 
supporting, self-fulfilling individual. In addition to these viewpoints, there are 
several other concepts in Gestalt therapy and psychology that may be helpful to the 
vocational evaluator, in helping his client to rebuild a new self-concept. These concepts 
will jbe presented briefly for your examination.* 

SELF-AWARENESS 

8. The degree to which one is willing to be in touch with his own inner experiences 
(feelings) is t\]^ degree to which one is open to experiencing the other jj^racn^ — la- 
interaction with other individuals, the best clue to understanding him, and how he is 
feeling, is to be .aware of how I am^ reacting, to him. The importance of this concept , 
to the vocational evaluator is obvious. An evalilator has many tools of evaluation 

at his disposal — "work samples, psychological tests, performance testes, interest 
tests, aptitudes, on-site evaluation, and situational assessment. However, his most potent 
evaluation tool is himself; his reactions, observations, and feelings at^jut the client 
are of prime importance. This subjective data ift<ITtvaluable in assessing a client's 
overall work and life potential. Th^^cquisitioik^f this subjective data requires . first 
that the evaluator be an excellent clinician who works with his client, and second that 
the evaluator realize that he is a unique individual interacting with another unique 
individual, the client. It Is difficult for an evaluator to be aware of his reactions, 
observations, and feelings, if he responds to a client from the role of a technician who 
merely administers tests. In order for an evaluator to fulfill his responsibility to 
the client, to the referring agency, and to himself, he must go beyond objective data 
and experience the client as a person. At our present stage of testing development of 
most of the tools used by the vocational evaluator in evaluation settings, it is, or 
should be, very clear that they lack the sophistication necessary to make decisions 
solely. upon percentile rankings. A well-trained clinician, using the present tools 
available, can do an admirable job of providing valuable information to the referring ' 
counselor; however, given a poorly trained technician, the counselor receives nothing 
more than inadequately normed, psychological, and work sample testing data that does* not 
take into consideratic^n the uniqueness of his client. 

9. Another concept that has applicability to the evaluator is that of THREE A*s. 

a. AWARENESS of what I do and how I do it. Awareness is the direct experience or 
contact with reality. - ^ 

b. ^ ACCEPTANCE of what and hqw I am. 

c; ALLOiro^G 'myself to be the way I am. ^ * 

Without all three ~ AWARENESS, ACCEPTANCE, AND ALLOWING ~ either in the evaluator ot ^ . 
the client. — growing is greatly hindered. The ratifications of the THREE A^s are numer- 
ous. So^often a disabled individual is painfully aware of his disability, but often he 
is .not aware of how he uses his' disability to meet his needs. In addition, a disabled 
individual often has difficulty accepting himself as he is and allowing himself to be 
that way without recriminations, feeling^ of inferiority, or self-pity. An evaluator 
can often pjyjvide experiences for the client which will help engender feelings off 
self-acceptance in the client. Frequently, diiVing the evaluation process, th^ client 
becomes aware of many skills and unique talents which he possesses, despite his handir 
cap. He may also learn of areas of potential wT?lch he may explore further and possibly 
develop. The client *8 self-acceptnace may also be developed through the evaluator *s 
acceptance of the client — his right to a good job and a meaningful life. 



.J 



. r 55. 



10. After self-acceptance <jC<imes ALLOWING. Allowing does not mean complacency or 
stagnation. It means a recognition of strengths and weaknesses, a knowledge of personal 
limits, and a realistic appraisal of what the client' is capable of doing. Allowing means 
no fruitless baying at the moon ("for how I used to be" or "how I could, or shoulfl, have 
been"). It means striving to use my strengths and weaknesses, in the most powerful 
combination, in order to enhance my life. Generally, the degree to which I am willing 

to be aware, accepting and allowing of myself, is the degree to which I am willing to 
be aware, accepting and allowing of others. Thus, in order to understand, empathize 
.with, and evaluate others, I must have respect 'for myself and the goals of my profession. 
This is also extraordinarily true for the client." If he is to have a meaningful, fulfill- ^ 
ing life, he must have respect for himself and understand how he fits, with his unique 
qualities, in a very complex and sometimes overwhelming society. The evaluation process 
can contribute to the development of this insight, and c^ offer the client an opportunity 
to take thax first step back to rebuilding his self-concept—successful rehabilitation — 
ability to take his rightful place in society. ^ 

11. A final illustration that I wil* use forp ^this paper io that of laming. Perls j. 
defines learning— "^o discover that something is possible.^ This definition for me 

is the essence of the entire evaluation process. The task of the evaluator is to use 
his clinical skills, creativity, imagination, and the tools of his profession to aid 
the client in discovering what is possible for him. Given the foundatic^n of a good 
vocational evaluation, and the assistance of all othej: components within the reha- 
bilitation process, especially that of the relationship between the counselor and 
the client, I feel th,at the basic underlying viewpoints of both the Cestaltist and 
the vocational evaluator can bring the client from ^point of societal dependency to 
his ultimate and self-directed independence. The problem is simple. If the client's 
self-concept is that of dependency, then he must first embrace and develop the internal- 
self-confidence to see himself as an independent individual who has something to offer 
himself, as well as the society in which he lives. If the client is thrust through 
the rehabilitation process into either competitive placement, vocational training, or 
additional education without rebuilding that all-important self-concept, then we in 
rehabilitation have done nothing except contribute to another experiential failure. 

12. It. has been my personal experience as a floor evaluator that. those clients who, 
through the process of vocational evaluation, gain genuine insight into their strengths 
and weaknesses are better equipped, due to the evaluation process, to succeed in the 
rehabilitation process. Ope of the operational goals of those evaluators who worked 
under my supervision was that if the referring counselor or the referring agency from 
which the client came were to drop out of existence the day following the client's 
completion of evaluation, then the client should have gained some additional insightrs 
into his own strengths and weaknesses that would give him a better chance to compete 

in a complex society. Knowing this to be an unrealistic goal for all clients, I still 
m^ntain that if it becomes the true goal of the vocational evaluation unit many clients 
can take that initial step back to personal ii^ependence. 

13, . It has been my concern for a number off years as a practicing vocational evaluator 
that evaluators often rely on their evaluation tools Without ^taking into* consideration 
the inadequacies of those tools. Even as thV-field develops 'today , both in the private 
and the norr-pjjh^ate sectors, this basic problenNis not being resolved. Therefore, the 
abij.ity of tHec^'inician, the vocational evaluator with clinical skills^ becomes even 
more important to the success of the rehabilitation process. The vocational counselpr 
and the evaluator, working as colleagues for the purpose of bringing a client from a 
point of societal and personal'^^dependency to that of independence, becomes a team that 
is unequalleif'in any other human service delivery system. 
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CHALLENGE TO FORUMS . 

I^rant that our knowledge in Vocational Evaluation is limited and that our concept 
^ t be rounded out with borrowed or improvised propositions. But sutely we 
lually incorporate such knowledge as we have with that of other fields. Let 
make ^ jnistaKe about it: our job is to throw light on the nature of man. As 
f^i>CMl. and realistic men, we must commit ourselves completely to those views ^bout 
that we think are most worth the gamble. As Vocational EvaXuators, we owe it to 
^selves, and to others, to say what particular assumptions we are prepared to.^act' 
upon, in order to clarify our own thinking, to give more consistent direction to our 
profession and, with respect to clients, to let them know what they are going to' get 
•for the time and energy they spend, 

QUESTIONS 

15. It is my opinion, that the field of Vocational Evaluation has made significant . 
str|d^s, ^e|i)ecially ,in t^p last few jfears, towarji^, ^^elopiog methodolpgj^^ that. * , - 
demonstrate its usefulness in the rehabilitation process. Based on this statement, 

I question whether the practitioners in the field (forum members) are willing to 
address themselves to the future of our field, or whether they will be content to 
rest upon those techniques currently be l©g used without adventuring into the unknown, 

16, The question frequently put forth asking that evaluators define their role in 
the rehabilitation process is an antiquated one at this point in the field's develop- 
ment, I am asking the fonim to address itself to the question of the evaluator/ 
counselor relationship, as it relates to the clients they serve, (Are they colleagues 
offering their particular skills in the rehabilitation of a client or are they in 
competition, each trying to secure professional territorial boundaries?) 

v/ » , • THOMAS L, BRANDON 
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1. The quality of the Interpersonal dynamics between the evaluator and the client will 
be a critical parameter in our efforts to further professionalize the role of the 
vocational^ evaluator . If the evaluator is to achieve self -acceptance as a professional 
rather than a technician, he must develop competencies in the applied science of 
clinical observation, and longitudinal evaluation of the work-related behavior of his 
client../ Ee must begin to function as a key facilitator who not only identifies 
specif it vocational potential^but also opens up options which will further develop 
his clidQt^s functional ability-v He must become a specialist ih evaluating man in 
his work environment, with major concern for the constellation of responses needed to 
develop a healthy work personality. 

2. The evaluator must have concern and a continuing role in the entire rehabilita- 
tion process. Job placement and retention feedback must ba used to determine the 
effectiveness of his interaction with^he client. He should have the ability to 
control the institutional decisions an^ structures* so that they *e responsive to 

^ his 9linical observ,a-tipns as to when and^how the evaluation process tegips^and is 
^ responsively moJSie^d'/ Our discussion of *these issu.ed* siibuld re^lt* in*a 'changed 
perception of the entire field of vocational evaluation, and a concert for a different 
kind of technology — a technology concerned with involving the client in a growth 
promoting way, with the realities of specific environments. We must accept the^ 
responsibility of working with the client to achieve a mutuality of goal and seek 
ongoing, reciprocal interaction that is both verbal and nonverbal, based on human 
dynamics, and not on institutional or technological imperatives. 

3. The evaluator himself has written very little on interpersonal telationsi>lp 
with. his client. Most of the literature in the field relates to counselor-clf^t 
interaction and ignores the Impact of the evaluator^ s personality as a means of 
enhancing client motivation and self-regard. Lustig has developed, and^his students 
have applied , a method of differentially structuring critical stimulus determinants in 
the total work environment for each client. Although concerned primarily with work 
adjustment training, this clinical treatment is equally valuable in initial vocational 
evaluation. Dunn has also described .a developmental model which assumes that the., 
faulty behaviors and performances identified by the vocational evaluator can be 
modified or eliminate by the application of specific treatments. He emphasizes 

that work evaluators must assume a developmental posture and show an awareness of the 
work linplicatious of a wider range of human behavior and behavioral change models 
than is the case when the prediction of a vocational area is the sole objective. 

4^ The Chicago JVS Research Utilization Laboratory has developed a. guide and manual 
on client observation and client evaluation in workshops which have been demonstrated 
to be very valuable in increasing the sensitivity of the evaluator as a client-interactor . 
Pruitt, in his survey comparing graduates of Master *s level training in evaluation 
with other evaluators, has recommended greater emphasis on competency skills afe op- 
posed to course content. Overs has studied the effect of higher anxiety on the 
ability of the client to participate fully in the evaluation process. He suggests ' ' 
that evaluators be more skillful in hel^g their clients cope with the stress ^ 



raised by the evaluation situation. 



5. Many otEer^iters have stressed the Importance of accepting the c^nt as an 
equal interactOr in the evaluation process. Qlshansky has described/a greater role 
for the cliejrt as. a decision maker. The participants in the University of Pittsburgh 
Cofiference in 1970 on Vocational Evaluation and Work Adjustment Service? In Manpower, 
Social Welfare, and Rehabilitation Programs concluded that elaborate kf forts to develop 
an effective systems methodology wrfuld not reduce the need for more sWllled and more 



ERIC 



58. 



. professional clinical approaches to client participation in the evaluation process. 
Brolin^s article* on the special challenge of evaluating the mentally retarded is a 
good example of professional attention to the differential approa,ches necessary with 
each of the major disability groupings. .Rusalem and Baxt, analyzing the delivery 
system in rehabilitation, observed that most published materials concern themselves 
with environmental, rather than attitudinal, variables, reflecting a, generalized pre- 
occupation with systems, rather than with deliverers "and recipients. Ayers has 
J? written on means of making vocational evaluation more relevant to-^the disadvantaged 
clients. Lawlis has developed a methodology of rating the interpersonal skills of 
the rehabilitation professional. His concern is with empathy, warmth, and genuine- 
ness; his ratings are based upon evaluation of client responses and perceptions, 
rather th^n therapist self -evaluations. In summary, the published material in the 
field is adequate only as a stimulus for much more writing and discussion .by evalu- 
ators themselves. 

6. My own experience as a practitioner in vocational evaluation has stimulated me 
to think in terms of reciprocating interactions between the evaltia^tor and the client 
in a group relatlofiship best characterized as socio-productive. Becadse the %j$t\i 
environment creates opportunity for closing the social distance that separates the pro- 
fessional helpers from the t^elped, I would like to suggest discussion of some roles 
that the client might delineate in this situation: I am sure he would stress his need 
for competency, predictability, and openness in your responses to him. I am equally 
convinced that he would like to have some control of the distance f the content, and the 
intensity of the relationship. 

7. If we ^v lew the evaluation as social learning, rather than isolated learning, we 
should be able to establish a more meaningful intermediate, as well as long-range 
goals with the client. If we focus on vocationally, realistic behavior that is 
achievable with reasonable effort and use success to irf^^tese motivation, we can then . 
use increased motivation tQ^raise both levels of performance and goals, 

8. I hope we will also explore the Implications of many clients not being able to 
meaningfully interact with the evaluator because they place the locus of control 
outside of themselves. I would suggest that we accept some responsibility for 
identifying this behavioral trait, and seize the opportunity to break the pattern. 
When a client feel? he has no control over what happens to hlla, evaluation is at best 
a one-sided process. - 

ji 

9. A major observation has been that the evaluator ^s not as preoccupied with tech- 
nology as the structure of vocational evaluatiooi systems would Indicate, He jLs in- 
volved in joint reality testing with the client. I believe Tie is now ready to chal- 
lenge the system and to function as a client advocate by seeking a more cllaical, 
comprehensive, and continuing role for himself. 

10. The parameters of a dynamic relationship between the evaluator and the client 
must be explored on a theoretical level. The lack of even a vague model should not 
discourage our exploring theoretical .issues. We can perhaps best ^o this if we focus 

on the gaps, between "theory" and "practice,^' In theory, we are Involved In. a screening- 
in process. In actua^. practice, ik)st, vocational evaluation systems screen clients out ' 
of many potential vocational training and employment goals because of their focus on 
current functioping. Instead of a client's severe developmental need increasing 
attention, it tends to result in options being severely limited and success potential 
decreased. 

11. Usdane has pointed out that very minimal use has b^en made of integrity groups in 
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vocational rehabilitation. Since integrity groups represent a major strategy for . . 
balancing the power of the evaluator with the weight of the group, we must assume that 
we have not really welcomed meaningful client participation* The prevailing practice 
of narrowing client options because of limited institutional training opportunities is 
directly contradictory to the rhetoric of "identified potential," This is perhaps best 
illustrated in how we utilize work samples. Row often, for Instance, do we seek to 
measure an Improved performance on work samples, anchsrelate to it, to the extent of posi- 
tive Interaction and resulting trust between the evalubtor and client? Do we even go 
back to sample one after all the other samples are completed to test this hypothesis? 
Do we systmatically try to Increase the client *s ability to make his own experiences? 
Do we recognize the reality of most evaluation leading to training rather than employ- 
ment? Do we measure psycho-social abilities as well as task abilities as a means of 
developing client competency? Have we learned, as professionals, to focus on undeveloped 
ability rather than present ability to meet hypothetical community norms? Are we con- 
cerned with the client ^s need to test new behavior? Do we provide opportunities for 
peer support, Premarkian preferences, self-knowledge, and the knowledge that we need 
client success for our professional satisfactions? ^ 

12, On the Important issue of the limitations of Jj^e eValuacor^s Interpersonal skills, 
do we acknowledge that each person has a limited ability to respond in a differential 
way to various people? Do we structure vocational evaJLuation relationships so that 
different roles are assumed by different people? Does the evaluator assign other 
personnel and use other environments to create the appropriate client interaction? 
Minimum access by the evaluator to the means of changing structural barriers to his 
professional functioning is Indicative of how great the gap is between rhetoric .and 
reality, 

13^ We must^espOnd to these questions with a frank dialogue on what needs to be 
done Wore we can plalm professional status as clinicians. We must respond to the 
analogy between the roles of the clinical psychologist and the vocational evaluator as 
opposed to thel^oles of the vocational evaluator and the psychometrist • .It is clear 
that we have already moved beyond the psychometrist in the scope and depth of our 
technical abilities, but we have not even applied basic behavioral management tech- 
nology in a systematic way. We can only achieve professional status if we develop 
clinical tools and abilities. It is, however, not necessary for us- to recapitulate 
the experience of clinical psychology with its historical preoccupation with diagnosis 
when it lacked an effective treatment modality. We do have effective and unique 
treatment tools. We can fuse the differential use of stimulus determinants in the 
work envlronmisnt with developmental and learning methodology, * to measure growth in 
the client's ability to function Independently as a productive person, 

jU. Stone has challenged us to look at the sources of evaluator bias In performance 
appraisal, Usdane asks, "is there some way for the client to perceive that on the 
day he enters the facility, he received service? He might then share thfe excitement 
of Immediat^e planning for the future," » / 

15, A challenge to our field is to describe a longitudinal role for the evaluator, that 
is not completed until he participates in an evaluation of client outcomes, perceived 

as a measure of the effectiveness of his services. The strath of our Interaction ^ 
should be greater internalization and generalization by the client of shared, growth 
experiences, • 

16, Jones and McCandless have questioned whether evaluat6r training sufficiently 
reflects concern for the therapeutic Impact of their personal Interaction with the 
client, Jones hae suggested that a dichotomy between clinical rehabilitation and 
counseling rehabilitation be developed. Are we prepared to become a major profession 



in the clinical rehabilitation f i^d? Will we deliver a^echnical work evaluation, 
tailored to the needs of governmental purchasers of service^ or will we become 
clinical professionals who are developmental in their..^pfoach to themselves and ' 
their clients? i 
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THE EVALUATOR AND THE COUNSELOR' \ ' ei. - 

Helping handicapped people achieve the maximum potential of which they are capable 
has long been one of the major objectives of the vocational rehabilitation counselor. 
In order to db, this, data has been needed, especially in the initial pfiases of the 
vocational rehabilitation process, relative to what 'activities the client cai;i do, and 
what he might be expected to learn to do. The evaluator-counselor relationship evoiv'ed ^ 
to a great extent as the counselor came to see, in many instances, that the client and he 
were unable to. develop a rehabilitation goal: Generally, the more severe the handicap, 
the Less likely the counselor has felt able to be of assistance, and when that; feeling 
arose, he may have declared the client non-feasible for services — but that's ant>ther 
story. Having a group of clients for whom he had no answers may have ^lotivated him' to 
seek out the consultative services of the vocational *evaluator. 

2. Thus began one of the mosf vital relationships in the rehabilitation process. 
This over-simplification, of course, avoids tracing the evolution of vocational ' 
evaluation, and more importantly vocational evaluators, in that our task currently is . 
to assess the state of the developments, as of today. Suffice it to say, that coxinselors 
felt a need for the assistance of their colleagues in evaluation, to help their clients 
and themselves, in determining suitable vocational objectives. As the liaison has 
developed, the more "difficult" ca^es in the counselor's caseload have found their way 

to the vocational evaluator. TJie relationship of the evaluator-counselor has, therefore, 
developed primarily to bring about the best possible services for the client. f* 

DELIMITATING THE TOPIC ' ; - , 

3. In reviewing the literature cottcernlng the human djmamics of the, evaluator and 
counselor, one f isds remarkably few articles addressed to that particular topic, but 
fh the few which are available, great changes are suggested over the past 16 years. 
Moed, et. al. (1957) suggest that the vocatiqinal counselor undertake the development 
and supervision of the pre^ocational unit, or what we would- call today a rudimentary 
vocational evaluation unit. They go on to say, "There must be a feeling of Inters 
dependence as well as mutual respect for the other team members* professional focus." 
In those simpler bygone days when the vocational .counselor may also well ^have been a 
vocational evaluator, especially if he worked in a residential as opposed to a field 
setting, .communication between the two specialty areas was far less difficult, since 
the evaluator and counselor may well have been tlie same perspn. Ori this bagis, all 
that the person needed to do was to* talk with himself, and presto!, there was instant, 
(hopefully, accurate^^ communication between evaluator and counselor. The basic 
notion of Interdependence and mutual respect -seem to be as^ timely now as it wa3 one- 
sixth of a .century ago. , * 

4. Gustad (1957) also sees the counselor as rendering at least some evaluation 
services. Five years later, Helfand (1960) uses 'the t;itle "evaltiators" for two. 
persons, who were also vocational counselors, althougt^-^fTIe^ primary area is not 
mentioned. ^ . * ' 

Bregman's article (1967) clearly suggests that evaluators and counselors ape not 
one and the same people, and he goes to some lengths in very cogently discussing the 
need for communication between counselor .and evaluator, pointing out that a^ frame of 
reference. needs to be established and questions asked to give direction to the evalu- 
ator and the evaluation process. Sankovsky (1969), in gathering data on rehabilitation 
counselor training programs and the vocational assessment process^ found that 93% of 
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the coordinators of rehabilitation counselor training programs, who responded to his 
questionnaire, indicated, a course in ^vocatiorial evaluation for their students. This 
perhaps suggests a,dif f erentiation of services on the part of the professionals about 
to enter the rehabilitation services field, and also an attempt to proyide the counselc/r 
with an appreciation, of , and feeling for, the evaluati^on process. . », ' N 

6. The testee as co-evaluator is discussed by Fischer Xi970) and provides an exis- 
tentially oriented view in client relationships that stresses self-determinism and 
"partnership in the firm" for the client in vocati6nal evaluat*ion. This notion of 
having "three peers" working together on the evaluation model is different from the 
"two peers and client", and may be somewhat upsetting to the more traditional evaluator- 
counselor model. Wright's (1971) notion of advocacy may further influence the evalu- 
ator'-coiaftselor relationship. Burge (1972), in discussing the evaluator-counselor 
relationship, sees them as being interdependent,^ needing to communicate accurately on 
the identification of problems and assets. Articles by Ehrle (1967) arid by Tcrrcy 
(1972) suggest that und^er the skin, counselors and evaluators may^ be, much the same—that 
is to 'say people workers — who assess and prescribe. 

7. The last 16 years have seen a good many changes in the ^valuator-counselor roles. 
^ Formally, vocational evaluation departments were, in some isd^tances, developing 

within occupational therapy departments and relying on occupational therapists as 
evaluatoirs, or in some cases were part of a sheltered werkshop, relying on counselors 
as evaluators. Today, the^progracis of vocational evaluatioi^ appear to be separate 
entities and are primarily staffed by persons with .the tit I'e of vocational evaluator, 
who often- have graduate .level training in the area. /Homogeniety appears then to be 
otfe of the ot),servable trends. Coupled with this has ,b?en a developing sense of 
identity, amongat evaluators; wherein, they realized that they could make a unique 
contribution to the rehabilitation process,' and that; they were not just counselors 
Interested in appraisal. * , 

.8. This evolution has al^o brought about changes in the perception of the counselor 
toward the evaluator. • Counselors now tend to see vocational evaluation as a rehab ill- 
tat ipn service whiph has matured or come of age. The colleagues in evaluation are seen 
by the counselors as making equal contributions in the rehabilitation process to them- 
^elyes, occtipatiot^l therapists, audiologists, physiatrists, speech pathologists, 
irirernislt&; pocial workers,, and physical therapists, to mention only some of the 
specialty areas. , 

9. As the differentiation of roles has developed, evaluators see counselors as a 
vital link in the rehabilitation process ,and, often, as a coordinator of services given 
the task of sjmthesizing the findings of many different evaluators-^^ocational, medical, 
social, audiologlcai, psychological, etc. Now that the participants know more about 
what each does, they feel more comfortable and are aware of their mutual contributions, 

10. Therfee personal observations are not to say that all has developed into sweetness 
and light between evaluators and counselors. Groups sessions and regularly scheduled 
discussion between evaluators and counselors seem to be beneficial in avoiding conflict 
^nd\s6eing that the client does not "become an object of displacement. Communication 
3^'t\.^eiBn the evaluator and counselor *is vital also to let each other know of any infor- 
mation germane to the evaluation or counseling aspects or, indeed, to the goals of the 
client. ^ 

11. Practice is based on sound theories. Theories tend to organize beliefs and / 
assumptions, and tend to guide one's behavior. Theories evolve and are used as lon^ as 
they are functional, or until^a new set of theories are developed, which tend to before 
functional. The point here being made is that theories are dynamic — they c,hange as 
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knowledge is gathered and as hypotheses generated from the theories have been either 
supported or not supported by research. This notion of change is tremendously important 
to remember in thinking of vocational evaluation and the evaluator, but change has been 
equally rapid within the field of vocational rehabilitation counseling and the counselor. 

12. With the differentiation of roles .between evaluator and counselor r-sometimes beco^iing 
greater and sometlmefe becoming lesser, and owing to agency needs at the time, the evaluator- 

•coiSselor role has been at times strainerfi^ Ambiguity may result when one is not dealing 
in concretes, but in abstracts. Evaluatora changing work settings, after having learned 
a certain relationship to an agency, where that former relationship is no longer 
appropriate, may have tLnded to f liid ^this upsetting. Comfort could be taken, however, 
as each of the practititoers realized that they were in the process of becoming special- 
ized in their services a^d that each had a unique background of knowledge in their 
specific areas. New knowledge continually being amassed and, with this accumulation, 
the practitioners couid begin to ffeel more secure. With feelings of security developing, 
defensiveness, rigidity, authoritarlattim, and bigotedness could be put aside. 

13. The tljue may well have arrived when the state of the art and science in vocational 
evaluation, and especially-^ the evaluator -^counselor relationship, has acquired a broa'd 
enough theoretical base to enable some general postulates to' be advanced. First is the 
notion that both counselors and ^valuators are here to stay. Second is the belief that 
the two specialties have generally developed high regard for each other. Third is the 
suggestion that evaluation, evolved to fill a need in serving the more severely disabled 
clients, has probably made vocational rehabilitation feasible for t>iousands of 'clients, 
who in former years would have been considered non-feasible. Fourth, counselors and 
evaluators are more and more seen as specialists and, to ^reat extent; counseling and 
evaluation are no,t done by the same person. Fifth, gfaiiuate. level training is available* 

■ for both evaluators and counselors now, whereas originally counselors had more educat- 
ional opportunities. 

14. It is a basic notion that change Involves pain. As* evaluation has changed, and 
hopefully grown/ the evaluator-counselor relationship may have had its share of that 
pain. Counselors were faced with admitting that they needed the assistance of evalu- 
ators. Admitting that we cannot be all things to all men can be a- difficult act. 
Abdicating responsibility also entailed abdicating power. Human nature being what it 

is, and our culture being what it is, most people are not trying to decrease their power, 
and any decrease may be perceived as threatening to the counselor, as well as any other 
person. It is also worth noting that if the counselor's supervisor had directed the 
use of an evaluator by a counselor, who was reluctant to do so, the relationship probably 
began on shaky ground and deteriorated from there. 
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15. In order to evaluate the human dynamics of the evaluator-counselor relationship, 
several questions are offered: What are the pre-conceived Images which the evaluator 
and . counselor ^old of each other? More basic even than this question is wha.t are the 
pre-conceivtiu ^mages that the evaluator and counselor hold of themselves? Are these 
Images accurate? How do they know they are accurate? What does accurate mean? Do 
evaluators and*^ counselors understand each other's role? Do they understand their own 
roles? What lis understand? *What is role? . • ' ' 

s 

16. Are counselors willing to let evaluators be "counselors in residence", or do they 
merely want faots reported so that they might do the counseling and decision making 
after the evaluation process is over? Are counselors threatened 'by having evaluators 

do counseling? Do Waluat6rs have training to do counseling? Are evaluators threatened 
by having evaluation done by counselors? Do counselors have training to do evaluation? 
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Is it possible for evaluators not to do counseling — at least a small extent? Is it 
possible for counselors not to do evaluation — at least a small extent? What differences 
ences, if any, exist in the evaluator-CQ,unselor roles b.etween evaluators and field 
counselors as opposed to evaluators and facility counselors with whom they are in 
physical proximity? '/ , > ' '^^^ 

17. * Do counselors trust evaluators enough to share background data with the evaluators? 
Do evaluators trust counselors eilough to share "all the data" with the counselor? ^ 
Are there times when withholding of information by the evaluator or counselor from the 
other, prudent? How may the sharing information be done so as to, enhance the 
evaluator- counselor relationship? „^ *' * 

18. Do evaluators and counselors hont>r each others education, experience, and intuitions? 
To what extent does intellectual snobbism pervade the relationship? How is the relation- 
ship effected by r^ifferent academic levels of accomplishment — ^^the master *s level evalu- 
ator and the baccalaueate level counselor. The master's level counselor' and' the 
evaluator who completed studies at a trade school? Do you see any changes here?. 

,19. It has been said that evaluators are now doing much of the work formerly done by 
counselors — say, 5 or 6 years ago. This appears to be in addition to the usual 
tasks as evaluator. Many see the counselor 's' role as tfecoming o'ne of a coordinator 
of activities. If this is so, How might the transfer of duties best be accomplished? 

20. As the notion of Work Adjustment ^s a treatment jnodality comea.to assume its ^ 
rightful place as a means of effecting, human behavioral change, a problem may arise 
as to which profession^ would best be .suited tol apply that treatment. Questions will 
doubtless arise as to whether the counselor woulfl be better equipped to purvey the 
service, since work adjustmeij^t may be considered; a treatment modality, equally as effi- * 
cacious as is counseling, and specifically because it is just that — a treatment. On the 
other hand, if evaluators are becoming mor^ inclined to see themselves as treatment * 
persofinel as opposed to appraiskl specialists, then conflict may arise. Perhaps work 
adjustment will ultimately see the development of a unique program to train its own 
practitioners. Until that d^y, however, the possibility for conflict between* evaluator 
and counselor seems to exist. Perhaps a challenge to all of us is to get to know each 
other better, ii counselors could join evaluafprs in their work, f pr a few days, and 
evaluators assist counselors in their work, for a few d^ys, perhaps once or twice a. 
'year ,^ each might have an increased appreciation of the contribytions^o^the other. 
There is an old saying that suggests that, we "... neyer judge a person until you have 
walked, a mile in his shoes." This would seem to be goo'd advice for counselors, 
evaluators, and all of us in the^^field Jto 'pursue. ' * • " 
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THE EVSLUATOR AND OTHER PROFESSIONAtS ■ / • 65, 

!• .Vocational evaluation is quite dependent upon medical, psychological^and 
social data,^ The vocational evaluator suffers because other professionals do ngt * 
have a basic undetstanding of what vocational evaluation means and encompasses. ^ 
The vocational evaluator is in a peculiar position whose role as' a distinct pro- 
fessional has not been fully accepted in the health and social science fields. 
His role is sometimes confused with rehabilitation courtseling. 

Thfe vocational evaluator tries to obtain and synthesize data from other disci- 
plines* He requests specific answers to questions about the client which enables 
• him to make vocational recommeirdations. The use of data from other professionals • 
•is an essential t6ol of the evaluator.' The evaluator wd^ld be unable to function 
wittoiit a thorough knowledge of a .flient's. medical, psychfetisU, psychological, 
ancJ^cial history. The 'extent of the client *s physical limitations, psychiatric 
diagnosis, family history, and educational achievement is of^ramount importance 
to the evaluator, who uses this data to develop the client*T vocational objectives, 
for ultimate training and employment. ; 

OVERVIEW 

3. Rosenberg (1970) states that the evaluator *s role is amol^thous and unclear in 
relation to" other professionals. There is a need to esj;ablish effective communi- 
cation with other professional disciplines if eyaluators are to gJain acceptance as 
a distinct profession. The vocational evaluator ca^ develop lev^stf competency 
based on, his knowledge, skills, and education. Continuing education can assist the 
evaluator. to overcome his inadequacies and enlarge his role with other prof essionaWft 

^ • 4, Speiser (1970) feels that an essential component of vocational, evaluation is 
* ' diagnosis or identification of client ^needs and problems.. The evaluator, though 
placing emphasis On work, must be Completely objective and be^concemed with the 
total needs of fehe client. If the evaluator lacks the skill^r knowledge, he has 
the obligation" of aiding the client to o^btain appropriate services ^Isewhere. The 
services of other professionals must be requested. with specific reasons for the 
referrals to tiiese other disciplines. . ^ 

5. Gorthy (1959)7 who was an early pioneer in the comprehensive team approach in 
. rehabilitation, .emphasizes the close integration between the work sample technique 
of evaluation and the medical profession* The physical evaluation and establish- 
ment of preliminary goals should be an initial step in any rehabilitation process. , 
^Jurther assessment is obtained through tljifi physical therapy and occupational therapy 
evaluation, especially for neuromuscular disabilities. The medical assessment can ^ 
^ dssist the' vocational evaluator in determining. the client *s physical capacities , and 
limitations in terms of specif ;J.c fob areas. The physician can' prescribe' medical 
treatments to Improve'^^ocatfonajt performance, work tolerance, and prosthetic 
devices that will improve vocatiotial perf orrg^ce.. ^en the client nears the' end 
of vocational evaluation, the physician can review the specific vocational* recom- 
. mendations to consider their compitibili-ty. with t^ long-tettil*feealth needs of the 
client. ■ » ^ 

> -6. .McGowan (1969) describes ttee purposes of medical evaluation in vocational reha- 
bi/itation which are: 1) to establish an impairment that materially limits the 
activities that the client dan perform^ 2) to appraise the current health status of 
thd client with a view to determine his limitations and capacities^ 3), to determine 
wha\ medical services can remove, correct^ or minimize the-client^s disabling condition; 
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and, 4) to provide a realistic basis fot selectipft of an employment objective that 
is commwsurate with the disabled individual's capacities and limitations. There 
is a need for the evaluator to interpret -and use medical, social, and psychological 
information appropriately. Thfough* these professional services, he is better able 
' to make vocational recommendations, with due consideration, to the total client and 
his problems.* ^ 7 ^ • 

' ' PERSONAL OBSERVATION 

% 7. The vocational evaluator, functioning in a rehabilitation facility, has grave 
difficulties working with other professionals outside hi? agency, TJie medical and 
psychological data obtained from these professionals' does pot answe/the many 
<luestions that' an evaluator has in wording with the client. The da^ is not 
geared to provide the evaluator with up-to-date inf ormation ^on the client's 
present and future physical limitations and prognosis for work, 'the client's 
overall personality ^nd how he gets along with people, and the family constel- • 
lation and^their feelings about the client's ability to go to work. 

. 

8. In general, the vocational evaluator has had no direct personal ^contacts with 
the outside physiillan, psychologist, and social worker. These professionals have 
never visited the facility and have little understanding of vocational evaluation. 

In most cases, contact has been made by telephone, and; other professionals seem uncon- 
cerned with the client's ultimate vocational objective. In emergency situations, it is 
difficult to- get the outside professional, and; the vocational evaluator must make an 
immediate decision In handling a specific problem. 

9. It is my opinion that evaluators have been lax In educating other professionals. 
They have ^pected others to know about vocational evaluation when they. have done ^ 
little te become involved with other professional groups and organizations, such as, 
A.P.A. , AMA, APGA, N.A. S.W. , *A.O,T.A»., etc. ' How can other professionals respect the 
vocational evaluator functioning In a rehabilitation facility when his role .has not 
been clearly delineated? Evaltlators are not clear concerning the nature of their 
role In rehabilit;Ation. When they Interact with physicians, social workers, 
psychologists and other prof essionals, they have k tendency to feel timid and exhibit 

* a reluctance to express themselves freely. Evaluators fail to contribute the full 
measuf e of their skills and competence In education and the team process. 

10. The functions and responsibilities of the physician, psychologist, psychiatrist, 
and socl^ worker are clearly defined and understood by all professionals. The 
vocational evaluator 's role as coordinator and synthesizer of Information has been |. 
confused with the vocational counselor 's 'role. In some agencies, the vocational"* 
counselor and the evaluator 's rol^e are combined Into one posi'tion known as counselor- 
evaluator. He performs the duties and responsibilities of both professions, and ' . 
assists the client toward a suitable vocational objective within his capabilities. 
There is a need for reaching the ^evel of true cooperation between all professionals. 

' , PRACTICE and' THEORY ^ ' ^ 

11. The vocational evaluator must be flexible and prepared to meet^each client's 
particular needs. He bears the responsibility to accumulate all the necessary data 
and determine the need and extent of medical, psychological, jpsychiatric, and social 
evaluations required to serve the client. He must know how to make use of the in- 

'formation obtained to help , the client know |ind understand himself, and to help him arrive 
at a feasiljle vocational objective. This requires that the vocational evaluator 
understand his unique rble in the rehabilitation process, and t^jhat the others par** 
ticipatlng understand ^theirs. The evaluatot has a strong desire to be respected 
by all professionals. ' ^ 



67. 



12» The vocational counselor depends on the vocational evaliiator to provide him ^ 

with certain information that enables him to develop specific vocational irecom- 

mendations for client, T^e evaluator must integrate all pertinent information 

and relate it to an appropriate vocational goal. 

* ft 

13# The lives of professional people are molded hy their chosen careers, .Their . 
- roles determine the work they will do, the people they will associate with, the 
nature of their interpersonal relationships, and even their values and goals. Their 
roles determine*, at least in part, what persbtis in other role* think of them. A 
professional person is not isolated • He works with colleagues on similar tasks 
and perceives himself and the others as members of . the same group. , A member o^a 
profession may be secure or insecure in his. relations with members of other, pro- 
f essionst This security is a state in which a person feels that the needs he 
aspires to will be gr^ified, and will be satisfied, in a given relationship with 
others. 

14. There is a need to develop, and mutually agree upon, a common set of goals for all 
professionals working together. In some cases, the functions, and role responsibility 
can be arranged so that the interactions of persons with those in different pro- 
fessions will satisfy mutual needs. Procedures must be organized and smicft;ured so 
that unsatisfactory relationships are identified, analyzed, and approp?iate^adjust- 
ments made. The functions a professional perforins, and the required relations he has 

-with others, specifically det^ine the nature of relationships and interaction. If 
^a specific professional discipline accepts the vocational evaluator, this acceptance 
does m^ch toward eliminating stjrain in his role relations* / 

SOME <5IJESTI0NS 

15. The major issues in clarifying the role of the evaluator and other professionals 
outside of the facili'ty center around the following: ^ 

1) What is the role of each professional? 

2) How can the vocational evaluator be considered an accepted member of the 
professional hierarchy? 

^) How can (the evaluator 's contributions be recognized by outside professionals? 

4) How can putsicHfe professionals know the specific services offered in 
vo ca t iona J\ evalua t ion ? 

5) How can 6y^luators participate in .professional meetings of other organizations? 



CHALLENGE • . 

\ ^ ' ^ 

3ft. The overall clhalj.enge to the rehabilitation fielii is: how can relationships be 
Improved between t|ie evaluator and other professional disciplines. The evaluator has not 
been truly accepted by other professionals 6n an equal basis in the same manner as 
medicine, psychology, social work, and counseling. The evaluator 's role is misunder- 
stood by most professionals and he is considered a disseminator of information on 
client's skills, and! aptitudes, with little consideration to his overall observations 
and impressions] of Personality and emotional adjustment of the client. There is a need 
to strengthen tie evaluator 's role with other professionals. Role relations are the 
key to professidnala working together. Evaluators are facfed with a basic dilemma in ^ 
their relations^ipB^ith other professionals, especially physicians and psychologists. 

17. The basic challenge in rehabilitation is to help evaluators, who are in nefid of 
social interaction with other professional groups, "Examine the consequences of their 
acts for ope another land plan ways of eliminating situational effects which cause 
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insecurity and strain in interpersonal relationshipB, The need. to develop and agree 
upon a connnon set of goals for all professionals is absolutely essential* Through this 
commbnality of goals and responsibilities, the vocational evaluator can achieve the 
status and acceptance as a C:6ntri6uting member of the prof essiona^l team, . 
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• ' THE EVALUATOR AND THE FACILITY STAFF 69- 

!• The Human Dynamics between the Evaluator *and the other, members of the facility, 
staff plays a vital role in the process of vocational evaluation in the fatility ' 
offering comprehensive vocational evaluation services. This topic will relate to 
vocational evaluation practice which includes the'use of work samples, vocational 
exploration by the evaluator, and situational assessment involving other Tnemb||fs 
of the facility staff, with the purpose of predicting and identifying vocational 
goals for, and with, the client who is vocationally confused or has previously had 
no particular goals, ^ 




2. For the purpose of this paper, the Human Dynamics of the facility are those forces 
operating in, 'and betweenCthe Evaluator and the other members of the facility staff, 
which affect the vocational evaluation 'of the client. Dynamics such as coxnmunication, 
interpersonal relationships, interaction, ^elf -^concepts, role concepts, attitudes, 
prejudices, m^oods, rappor^^ and morale should be considered as they relate horizontal- 
ly and vertically. PositiveSwman dynamics, operating between the Evaluator and pthe^ 
members of the facility staff, will result in the practical application and utilization 
of the laiow],edge of individual members of the facility staff, to achieve vocational 

'evaluation of the client I 

3, In review of pertinent literature, this coordinator found a significant lack of 
information and discussion on the subject of Human Dynamics between the Evaluator 
and the'other members of the facility staff; i.e.. Administration, Department Sup- 
ervisors, and Para-pr6fessionals: The following paragraphs are concerned with the 
Importance of communication and understanding of roles, with stateijents supporting 
the necessity for positive j^teraction between the e^luator and other members of 
the staff. . 

4,. *jHorizontal communication among Counselors/Evaluators is usually rather good in 
any agency, but the vertical flow up and down the hierarchy often leaves much to be 
desired. On the vertical plane, parts or all of messages may be lost and new ideas 
smothered or distorted". (Research and Demonstrations Brief, 1969). Barton (1971) 
states, •'Many plans fail because key staff persons didn't realize they were supposed 
to carry out a certain action". Nadolsky (1972) found that, "Input of workshops per- 
sonnel and job tryout supervisors ^allows .the Evaluator to gather evidence concerning 
the overall feasibility of his tentative recommendations". 

5. Howe (1963) defined communication as occurring "whenever there is a meeting of 
meaning between two or more persons. To achieve true communication between person 
and person, each must accept his own and the other's' need for affirmation". Psych- 
ologists Brammer and Shostrom /1965) wjote, "If the Supervisor's energies are being 
dissipated in a continuous struggle to prove himself, or seek re-affirmation of his ' 
own Importance, it' will be difficult for him to /Si^ote energy^o facilitating the 
development, or alleviating the 'problems of others". 

6. Brammer and Shostrom further stated that, "Occupational information is more than 
facts about a job. It should be presented in terms of a way of life^ of a relation- 
ship between worker and job and relationships among workers..... Most jbbs require 
the client to conform to expect4tion8, to be a team worker". Comment: .This state- 
ment provides a valid rationale tTiat the Evaluator and other members of the facility^ 
staff be cognizant of the need to maintain positive human dynamics within the facil- 
ity. This is upheld in the reports of the International Labour Office (1970) on 

The Basic Principles of Vocational Rehabilitation, of the Disabled . One of -the points 
outlined, that should emerge in a case conference with a team approach, was "Reactions 
to and relations with staff and disabled persons". The report re-affirms that each 
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facility staff member should understand all aspects of the program. Nadolsky (1972) 
editorialized, "Work behavior, like motivation, is a variable that relates directly 
to specific sittiations and varies with the situation. Work situations an<t^ experienoes 
are reaJL only to the extent that they are perceived by the individual as being mean- ' 
ingful and appropriate". ' ^ ; . 

, 7. Whethef the Evaluator is employed in a clinical setting or in a* rehabilitation 
facility which incorporates the use of situational ^assessment as well as work samples 
and vocational exploratiotr, it is the opinion of thj.s writer that the Evaltiator is the 
key person in the development of positive, human dynamics operating between himself, 
the client, and -the other members of the facility staff. 

< -■; 

8. The Evaluator *s role is more clear-cut and ^ecific than those of the other 
members of the facility staff. (1) Supervisors have product ion^responsibi3,ities, 
employee assignments and supervision in addition J;p the task of evaluation of clients 
in their departments. (2) The Para-professional or aide lacks professional training 
and the confidence which subsequently follows such training, making his role more 
dependent upon both the Evaluator arid Supervisor for goal direction. (3) The Adminis- 
trative Staff as program plannei;s, developers, and policy making members of the organi- 
zation should be, and are, firmly committe;! to the objectives of the vocational services 
within the facility. They are free to interact with individual Evaluators, but from 

my experience, more often rely upon the Administrator of Rehabilitation Services for 
.the staff liaison with the Evaluators, and thus communication is often limited to, 

brief informational or "brain-storming" sessions or casual conversation. 

\ 

9. The facility in^ which I work has developed from operating a sheltered workshop, 
with evaluation aild training service, to a comprehensive rehabilitation facility offer- 
ing medical, psychological, social, vocatiotial evaluation, work adjustment, training, 
and job placement services. Staff has increased frqm three (3) Administrative Staff 
Members, two (2) Prof 0,ssionals and five (5) Department Supervisors to Administration - 
eight (8), Professional - seventeen (17), Supervisor-Instructors - sixteen (16), Para- 
professionals - four ^(4). Included within the Professional group are four (4) Evalua- 
tors, three (3) Work Adjustment Counselors and one (1) Intake and Training Counselor. 
The Evaluator finds hiinself /jherself coordinating and interacting with at least fourteen 
(14) different membe»B of tl^e facility staff in the evaluation process. Example: In- 
take Counselor >n^edical (2) > ^Psychologist > Social Worker — > Para-pro- 
fessional (Service Aide) — > Department Supervisors (4-6) — > Para-prof essionalsj 
wlthii? departments (2) — > Administrator of Rehabilitation Services and Placement 
Counselor. This may extend itself to include another member of the Administrative 
Staff, if training in one of ^he shop areas is being recommended. Upon assignment 

to a department, the Evaluator presents th^ client to the Supervisor. He also leaves 
a client profile sheet with the Supervisor, including such data as what the Evaluator 
is looking for, tentative goals and the client's physical, emotional or mental limitations 
when appropriate. This is to promote mutual understanding and goals. The Evaluator ^s 
available for consult, planning, or counseling throughout the evaluative period. A' 
standardized behavior rating scale sheet is prepared by the Supervisor weekly, or at 
the end of the one or two day evaluation period^ Scheduled in-service trainingS^ids 
the Supervisors in their understanding of the use of this scale. The Supervisors • 
and the other members of the staff, who are directly involved in the client's ^vAlu- 
ation, attend the Staff Placement Conference, with the referring Vocational Counsi^Jfor 
in attendance. The Evaluator. is the team leader of the conference, but all staff * 
members are free to contribute information, make recommendations, and experience being 
a part of the dynamic process of evaluation. 

10. In order to promote and preserve a* favorable climate for positive human dynamics, 
weekly in-service meetings are held. The Administrator of jlehabllitation Services, 
Director of Operations, Evaluation Supervisor, Work Adjustment Supervisor, Training 
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Counselor, Departmental Supervisors, and Para-professionals are in attendance. Period- 
ically, other professionals and/or Administrative Staff members attend if the discus- 
sion subject is appropriate. In a questionnaire distributed to Evaluators, Supervisors, 
and Administrative Staff, areas of agreement were: (1) Understanding of goals of 
vocational evaluation; (2) understanding of the major role of Supervisor in evaluation; 
(3) understanding of the role of Evaluator; (4) Evaluator/Supervisors plan together, 
and feel they are part of the team; (5) In-Service Training beneficial. Variables 
included: (1) Supervisor attitudes regarding their role as boss, buddy, (5r counselor; 
(2) importance of production in the work-oriented facility; (3) relationship of Evalu- 
atqfr and Administrative Staff. 

11. The Evaluator is the interpreter of the system to the other members of the staff. 
This is accomplished not only by sharing verbal and written vocational information and 
questions, but also by acceptance of others, of facility staff as team workers and by 
efforts to maintain horizontal relationships with Supervisors. Supervisors must accept 
the role of team worker, rather than allowing the Evaluator /Supervisor relationship to 
become vertical because of the concept of professional service versus production. The 
^valuator, acting as a facilitator must be open, friendly, and must use language under- 
stood by the facility staff with whom he's relating* He must take into consideration the 
pressures', anxieties, and defenses of the individual staff member and be empathetic. The 
Evaluator should be the catalyst within the facility promoting positive human dynamics 
between the staff and himself to benefit the client. Thus, the Evaluator should be the 
key — thevcoordinator, the interpreter, the facilitator, and the catalyst! 

12. Evaluators and other facility staff members might readily agree that (1) an evalu7 
ation system exists, (2) there is a necessity for positive human dynamics operating 
within the facility, (3) there is a need to Improve or change the system to enhance 
positive human d3mamics. From that point, responsibility and reasons for the break- 
down of positive djmamics is passed to and from Administration^ Evaluator, Department 
Supervisors, and Para-professionals. To bring about iinprovement and change, Havelock 
(1969) suggests the need for social innovations that will create a human bridge 
between research and practice. Where do we begin? Change is painful, oft-en dis- 
ruptive, and resistance to proposed change can be great. 

13. Utilization of research findings can be the answer to improvement and enhancement 
of the present systems by bringing together the practitioner and research in an 
iriter-dependent relationship, findings (Research and Demonstration Brief^ 1969) 
Indicate "utilization of research findings do hot alrays require big programs or 
entirely new ways of doing things. Well-conceived minor changes can be v^ry help- 
ful". Havelock (1969) presented two methods of "Translating Theory into Practice". 
(1) Temporary systems of collaboration in which researches are brought together in 
seminar s/conferences. The author gives a good example of "how it worked" in a 
Kansas City Conference. Essential ingredients were (a) both researcher and practi-^ 
tioner contributed to planning, (b) mutual agreement on what practitioner needed, 
(c)^use of research evidence, practice, methods, models, consultants, (d) both 
worked on continous analysis and feedback on the human relations of the process, and 
(e) documentation, evaluation, and follow-up. (2) The author continued with a 
recommendation for "change agents" within the system, who work toward full-time , 
linkage of research and practice. The agent might work within large facilities 

or for the State Division of Rehabilitation, consulting wit^i several facilities. 

14. Some of the present "linking agents" which are readily available are (1) Research 
and Demonstration Briefs sponsored by the Research Utilization Branch, Division of 
Research and Demonstration, S.R.S., Dept. of H^E.W.j (2) Materials Development Center - 
Dept. .of Rehabilitation and Manpower Services, University ofr Wisconsin-Stout. This , 
is an information service providing up-to-date bibliography and short review of 
relevant literature, ioan of Ponographs and audio-visual aids relating. to vocational 
'^'^''Mation; (3) V.E.W.A.A. Bulletin^and other professional journals. 
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15* Human dynamics between the Evaluator/Facility Staff often produces tesults which 
can make or break the system. A positive example , of research in this area was proven 
by Chicago Jewish Vocational Services, Research and Demonstration "project (1972), 
Observation and Client Evaluation in Workshops - ^aPuide and a Manual * Twenty-two (22) 
agencies cooperated and tested one system. The advantages of the system described by 
agencies using it were (ly client evaluation instrument made observations of floor 
Supervisors more useful, (2) enhanced and improved communication, (3) elevated status 
of the Supervisor, (4) easier to organize discussion/planning for clients with avail- 
able system framework, and (5) cut time for achieving objectives of service. One 
important finding was, /*Evaluators/Counselors tended to accept the floor Supervisors 
on a more ec^ual level when it cac^e to understanding, evaluating, and planxjdng for 
clients. This added considerably to staff cooperation". 

16. As an Evaluator, you are part of a larger staff in your facility.^. These questions 
mu^t be considered as you review this topic. (1) What is your^elationship to the 
Administratgf s in your facility? (2) What is the Evaluator * s relationship with the 
Supervisoi/^ (3) What is the Evaluator 's relationship with tHe Para-professionals or 
others of xacility staff (with the exception of other professionals) with whom inter- 
action occurs in the evaluation process? (4) Are relationships impaired by a ^^pto- 
fessional caste system" which relegates clients to a first level, co-workers to a second 
professionals to a third and Administration to a fourth? (a)' If so, why? 

17. (1) What is the Evaluator's responsibility to other -members of the facility staff? 

(2) What is the responsibility of the Evaluator to' understand Administrat ion/Supervi-- 
sors?Para-professionals and their role in the facility? (3) Is planningT^al setting 
a joint responsiyiity? (a) If yes, whose joint responsibility is it? (4) What is, or 
should be, th^ responsibility of the EvaluatoV in the development of in-service pro- 
grams geared toward improving or bettering staff relations?- 

18. Attitudes and perceptions often block communications. Exkmple: . "I cannot hear • 
youi. because of what I expect you to say^** (1) What is the responsibility of the Evalu- 
ator iq-^veloping communication and alleviating this perception? (2) How important, 
is the Evaluator 's attitude in relation to improving human dynamics between himself/ 
-herself and other staff facility members? (3) WTiat attitudes and personal qualities' 
do supervisors need (in addition to knowledge and skills of their field) to do their 
job well? (4) How does the Evaluator handle 'mixed messages"? Exaraple: Vertical - 
Administrator to Evaluator,-) "Rehabilitation". Administrator to Supervisor "Pro- 
duction". Horizontal - Evaluator to Supervisor, -> "Rehabilitation". Supervisor to 
Evaluator, -> "Production/Rehabilitation"? ^ » 

J.9. (1) How Important are the human dynamics between Evaluator/Facility Staff in 
relation to vocational evaluation ©f the client? (2) Consider the factors involved 
in human dynamics vrithin the facility and between the Evaluator/Facility Staff. 

(3) What alternatives should be considered by the Evaluator to achieve maximum, 
positive human dynamics between Evaluator/Facility Staff for the purpose of con- 
sistent service to the client? (4) Wh&t is the plaoe of innovation and research 
on this Subject? 

20. Historically, proven knowledge and techniques are far ahead of the development 
of human relations, or acquisition of the social skills and processes which really 
make the, system work. This seems to be the fact proven by the lack of litetature on 
the subject o£ human dynamics in the evaluation process. As Evaluator s in the field, 
you are responsible for the continuing development ^f effective client-centered vo- 
cational evaluation programs. Part of your challenge, as an emerging profession, is to 
become the catalyst in promoting the positive human dynamics between yourself and the ' 
other members of the facility staff for the benefit jof your clients. 

^ . • , ' • SHIRLEY WHIPP . * ^ 
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1. "What yo.u^ se^ depends on where you stand" i?s perhaps the most succinct way 
of expressing the current state of the art of vocational evaluation. We are, ±y 
this national endeavor, attempting to come together and look at the whaler ea/5f 
vocational evaluation from a common stand. .First, we need. to bring togeufer^ * 
our experiences in the decision to refer to vocational evaluation, relative 

to tiie their effectiveness and current contradictions. Second, we need to develop 
a <:*ommon ideology that will provide a base for making competent decisions that 
will be applicable to, or at least understood by, all vocational evaluation settings 
and referral sources. 

2. The myriad of seminars, editorials, and technical writing on the subject of 
vocational evaluation have discussed the importance of the referral decisions, but 
have not researched how it happens. Specific discussion of the effectiveness and 
current contradictions in thfe vocational evaluation delivery system, which begins ^ 
with the decision to refer, has not been recorded by "ones who know" — clients and 
service staff themselves. Therefdre, writing on this topic is more professional 
opinion than research fact. For the review and discussion, this topic will be 
considered in terms'of four issues: reasons for the decision, who participates, 
what takes place first, and when is it mad.e. 

3. Cundiff (1965) presents "reasons behind the decision" in a training manual 

for Vocational Rehabilitation staff which discusses guidelines, advantages, and dis- 
advantages to be considered. This issue has been dealt with using clinic judgements 
of objective (as well as some subjective) critlria. Determining validities of 
criteria used in vocational evaluation decisions are discussed by Barton (1972). 

4. Who ought to participate in the decision to refer to vocational evaluation has 
received some editorial comment. Olshansky (1969) has written on the client as 
decision-maker. Messenger (1969) points out the decision-inaking role of the reha- 
bilitation counselor, contending that, the very clients in need of vocational evaluation 
are often unable to make decisions by nature of their brain damage or psychosis. 
Krantz (1968) makes the case for the evaluator as a major participant in structuring 
the referral process; he best knows the scope and limit of his service. Multi- 
agency participation is discussed by Truelson (1970), in his summary of the "Work 
Evaluation Center Project^' in Oregon, in which the State Rehabilitation, Welfare, and 
Manpower agencies each participate to refer clients to Centers operated by all three 
agenc ies. 

5. What takes place pirior to the decision to refer to vocational evaluation has been* 
described by Whitten (1970), in his interpretive comments on Section 15 of the 
Vocational Rehabilitation Act. First is the preliminary screening to determine that 

a client has an employment handicap and needs a service. Second is a comprehensive 
evaluation of pertinent m'edic^l, psychological, vocational, educational, "Dultural, 
social, and environmental factors of employment. Third is the decision to refqr to 
vocational evaluation. Fourth are goods and services to be provided as needed 
throughout. 

6. There .are several approaches in the literature to the issue of when to refer to 
vocational evaluation. Neubauer (1970) alludes to the early and routine referral to 
vocational evaluation in the Florida school system, in d preventative approach^ Bitter 
(1966) stresses a client-centered, flexible ipprWh, with client-readiness determining 
when to refer. A third approach is the coordination of vocational evaluation with an 
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initial job plaoement, on the premise that placement in paid, meaningful activity, 
provides the iiimiediat?*Tfee<J gratification necessary for client motivation in the 
vocational evaluation* Both Taylor (1970) and Olson (1963) advocate this approach; 
Taylor in his delivery system model for use by disadvantaged clients, and Olson in 
her discussion of v?ork relief as vocational evaluation. 

7. Discussing the issues to be dealt with in the decision to refdr to vocational 
evaluation is an overwhelming task. First, the vocational evaluation setting has 
to be considered. Are we talking about school vocational exploration programs, 
manpower orientation, rehabilitation centers, work relief, or hospital occupational 
therapy? Second, the referral source is important. Differing standards and pay 
structures affect generalization about the decision-making process in a referral to 
vocational evaluation. 



8. Based on observation and experience as a client service worker in four agency 
settings (a county welfare department, school system, a state vocational rehabili-- 
tation agency, and a rehabilitation center), the need for multi-agency cooperation 
in services to clients has become all too clear. Two common criticisms of decisions 
that have been cade in referring clients to vocational evaluation at the Minneapolis 
Rehabilitation Center (MRC) have been 1) lack of adequate predetermination and statement 
of specific reasons for the referral, and 2) lack of adequate preparation of the 
client and arrangement of support services during the evaluation. 

9. To deal with the first problem, MRC developed a Diagnostic Interviewing train- 
ing course (4-72), originally, to train State employment service through older worker 
specialists. The interview outline zeros in on problem areas, so that specific 
reasons for a vocational evaluation referral can be identified vith less terminology 
hang-ups. A Relocation Project and manual were developed (12-72)>to deal with the 
second problem, with the cooperation of the State Rehabilitation agency, changing 
their state plan to include payment of services for sigiiificant others, apartment 
desposits, and moving expenses. The reason for referral and preparation, needed 
prior to the decision to refer, are spelled out in the manual. | 

10. An additional issue relative to the decision to refer to vocational evaluation, 
that has shown up from experience, is the denial of vocational evaluation to a 
client for whom the decision was made. An example from each of three settings 
follows: . / 

Example from a Welfare setting ^ 
A disadvantaged client receiving county relief was referred to the state 
vocational rehabilitation agency (state VR) , and the decision was made that 
a comprehensive vocational evaluation was needed. However, the client had 
no indentif iable disability that could be labeled according to the state 
VR eligibility requirements. The county w^fare board would not pay th*e 
high cost plus r^om and board or transportation for the nearest vocational 
evaluation center,* and there was no work relief vocational evaluation 
program available through that county. 

Example from a school setting 
A 15-year-old student had behavior problems, which first led to expulsion 
from school, and then, the tutor .provided could not handle him. He was 
referred to the state VR counselor who interested him in a vocational 
evaluation center t^at had a. certified teacher to satisfy education require- 
ments. Because the student* was under 16, State VR funds were not available. 
The school system was then considered a. source f;:om which to obtain funds. 
Although the school system was willing to pay for the student *s education 
requirements, it would not finance his vocational evaluation^ Because the 
school he would att*end would not provide vocational evaluation*, he would 
^ - not accept the education. 
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Example from a state VR setting • • / 

An 18 year old, severly disabljed from degenerative muscular dystrophy , applied 
for VR services. A vocational ev^uation was planned as a means, to placement ^ 
in meaningful ?work activity. However, the tepiinal disability prohibited state 
VR agency acceptance for services, and the parents could not affotd the vocational 
evaluation center cost. ^ ' ' • . - 

11. A common thread mns through each' of these case samples. In each case the need 
for vocational evaluation was determined, but the availability of vocational evalu- 
ation that would fit the particular agency's structure was lacking, or the facility to 
fit the client *s need was lacking. The decision to refer to vocational evaluation 
cannot be made unless there is a vocational evaluation to refer to» Nor can the 
decision be made under present fee structures by a client who is not first attached 
to a referral agency, who either provides it or will finance it elsewhere. 

12. What are the reasons'for deciding to refer to vocational evaluation? Theoreti- 
cally, there could be several approaches to the decision. One approach might be 
standardized use of the VR training guidelines as discussed by Barton (1965 & ^972). 
Another might be routine referral after comprehensive diagnostic interviews have 
identified problem areas. In practice, reason for the referral are too often not 
conmmnicated effectively, nor based on the client *s real needs. Specific reasons 
for referral are clouded by the request for "a "general evaluation" , or there b 
no specific evaluation need identified at all. Large caseloads sometimes resist in 
wholesale referral of unprepared clients, in which case the reason for referraJ^ is 
"comprehensive evaluation which I CQuld do myself if I had time." With Social 
Security Disability Insurance applicants or Workman* s Compensation claimants, the 
reasons are well defined: to determine specific job possibilities, physical capaci- 
ties and/or retraining potential. When the evaluation Unit is under the same roof 
as the referral source, the reasons are also better communicated. 

13. Who participates in the decision to refer to vocational evaluation? Theoretically, 
the client would decide, after receiving adequate diagnostic preparation from the 
referral source, and with relevant support personnel participating by providing ^ 
collateral services as needed. The referral source would advise the client on the 
basis of a thorough understanding of the available vocational evaluation services, 
their appropriateness, and proximity. Included would be what the evaluation can 

and cannot provide, which suggests the evaluator as a crucial participant in the 
decision to refer. In pract;Lce, the client is seldom given the opportunity to decide, 
especially if the referral source decide^ the costs are too high. The referral source 
often does not communicate effectively to the client about what vocational evaluation 
can provide, so, the client passively accepts rather than participates in the decision. 
Or, for various reasons, relevant support personnel do not agree to cooperate in pro- 
viding goods and services, without which the client is out of luck. 

14v What takes place before the actual decision is made? Theoretically, the proposed 
referral would be preceded by a consideration of all pertinent medical, psycho-social, 
and voeational information from all relevant sources. Additional psychological test- 
ing would be obtained, if needed. Following a realistic appraisal of this information 
(or lack'of information), .the determination would be made regarding the necessity for ^ 
vocational plan. In practice, howev.er, there are communication gaps, time lags, or 
lack of access to an appropriate vocational evaluation service, which delay or even 
, block the proposed decision to refer. 

^15 When is the decision made to lef ep' to vocational evaluation? Theoretically, the 
decision would be^de early with aSdTient early in the vocational planning, not when all 
else has failed. IiiLpractice, about the only time this happens is in schools or 
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Institutions where the evaluation units are under the same roof, do not require 
special fees, and not a lot of red tape to get in to them* But in other referral 
agencies the processing of a client* often eliminates the possibility of early inter- 
vention, with the client, in turn, losing faith in all agency systems. 

16. '"How does the client get selected for this expensive technology (vocational 
evaluation), and what is he like? The questions are legion, ^nd the answers must 
not be long delayed." ^^nt^asked these questions in an editorial in the first 
VEWAA Bulletin published the winter of 1968. They are still unanswered, but the 
three year' VEWAA Project, begun in 1972, has included thesje issues as an intergral 
part of the study. 

17. Who is the client? What is vocational evaluation? Who is the referral source? 
What are the relevant supBioitive services and who provides them? To discuss this 
topic, we yill first have to come together and see these terms from a cotmaon stand. 
Is the client any handicapped individual, or only one with a diagnostic label, who 
has come to the attention of a referral source that has the capacity to pay for a 
vocational evaluation? Is the vocational evaluation in a public or private facility 
using simulated work samples, or does it include evaluation programs in schools, 
hospitals, and institutions? Are we including vocational evaluation services 
sponsored by welfare departments, state empj-oyment services, and private insurance 
companies? Are we defining supportive services to include family and significant 
others, or only professional personnel? Ate we talking about services^ other 

than vocational areas, such as personal, social, recreational, medical, and educational? 
In other words, how bro^ or narrow a definition are we going to consider in dealing 
with thls'whole issue of vocational evaluation? 

18. - It .is our challenge to bring some workable framework to the nebulous decision- 
making process that exists in the referral, "of the client, for the client, and by 
the client" to vocational evaluation. We must describe reality to enable ideals, 
based on our experiences and observations, re-defining those realities into a model 
for an effective, noncontradictory, decision-making process, 

19. It is no small task to change "what you see depends on where you stand" to "what 
you see is exactly what I see". But this is what is necessary, if we are to clean up 
our language and develop an effective foundation upon which to made competent decisions 
to refer to vocational evaluation. \ 

♦ * AVIS PETERSON 
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state of the Art 

1. At the present time, vocational evaluation is practiced, or mispractiped , in a 
variety of educational, industrial, and rehabilitation settings. These settings vary 
an scope, nature, size and purpose. The evaluator may be called upon to. assume a 
number of different roles, depending on the type of setting and the nature of the clients 
involved in the^ evaluation process. In viewing 'vocational evaluation from a broad per- 
spective^ it mus^^e^ecognized that the term, vocational evaluatifJn, is used loosely 
and defined vaguely in many settings . Definitions are usually stav^jed in terms of eval- 
uation techniques and approaches, and not in terms of evaluating htfman potential; this 
is evidenced ty the fact that, in many settings, clients proceed th^^ough identical 
evaluations. - 

2 Many vocational evaluators in rehabilitation settings have dif ficufty in conceptu- 
alizing vocational evaluation in other types of settings serving iridi:v^iduals without 
substantial physical or mental disabilities- They may still have a v6«|jt:io"nal, social, 
or educational handicapping condition presenting a barrier to the achieyewent of a ^ 
"maximum functioning level of society. 

.3. The concept of vx>cational evaluation differs in various settings; for example, 
it may vary -from a' diagnosis in learning disability unit to a general assessment in a 
technical training center. A job-oriented sheltered workshop may have different goals* 
for thei-r vocational evaluation programs than a comprehensive rehabilitation center. 
Some rehabilitatijJh settings evaluate client5r-§a?^^ecif ic jobs or training areas 
available in their setting; others may evaluate cll&nfe^L^r specific jobs, 
training adjustment problems, or educational, objectives, ^The settings which provide 
a "comprehensive** program of vocational evaluation usually also have al comprehensive 
program of services available for clients, either in the facility or in the community. ^ 

4> The relationship between a vocational evaluation program and other programs, jin a 
particular setting, depends on its impact on the goals of the o^rganization. In 
many settings, vocational evaluation has been an added component with great expecta- 
tions, inadequate preparation prior to implementation, and very little training/for the 
vocational evaluator. It is usually considered the vocational assessment component of 
the organization and the initial phase in the delivery system of services. Ttie goals 
of the vocational evalD^tioji urlfc^^are governed by the philosophy of the evaluator,^ 
evaluator-client ratio, expec;tatiT)ns of the referral sources, limitations of the phy- 
sical setting, as well as otheK^variables . 
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5. A review of professional literature revealed very lifetle information. conce^^ning the 
process of vocational evaluation in various types of .settir^s.. There are descriptions 
of educational, industrial, and rehabilitation settings with vocational evaluation un^ts. 
This description usually involves goals, such as "determining vocational potential," 
and listings of approaches and methods such as psychometric testing and evaluation systems 
There is a noticeable absence of research *in vocational evaluation, relating to its 
effectiveness in various types of settings. \ 
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Nature of 'l^ettings . / 

* - * 

6. It was in the typical rehabilitation^ settings , such as^the Comprehensive reh^abili- 
tation centers aiW sheltered workshops, that vocational evaluation became established 
as a recognized service in rehabilitation". ^Due to a peri(jd of rapid, unsupervised 
growth, vocational evaluation became established in th^se settings under a variety of 
names, conditions, and definitions. Also, a variety of techniques and apporaches have 
complicated the under st and ii^g of vocational evaluation in rehabilit:ation settings. In 
most rehabilitation facility settings, vocational evaluation ot>cupies a major function 
in the provision of vocational services. , ' 

7. In medical settings, the concept of evaluation is s'ometimes translated into a 
physical capacity appVaisal as determined by a physical therapisTi or work tolerance 
assessment by an occupational therapist. These assets and lii!i\t^ions may or may not 
be then related to vocational objectives and job, potential. ''Sometime^ evaluation is 
conceptualized as a process of determining behavioral and adjustment problems and recom- 
mending treatment programs; sometimes this is evident in ^nental health centers, com*- 
munity programs for discharged mental patients, half-way houses for alcoholics, etc. 
Even though a vocational assessment, will take place later on, the concept of evaluation 
is primarily centered around the reality of ^rspnal. and social .ad justment problems. 



Vocational evaluation in programs for the mentally ill are cpjnp'lics^ted by the na- 
ture of the disability that changes due to psychiatric trp^Ctmpnt , unpredictable pub- 
lic attitudes, and the lack of a definable, correctable handicap. In settings in- 
volved with the mentally retarded, the vocational evaluation process involves a series 
of structured learning experiences extended over a period of time. These complex • 
variables have necessitated a trial-and-error evaluation process, utilizing ihstitu- . ' 
tion woi;k programs, activity centners, job try*outs, and sheltered workshops. 

9. Some educational settings have initiated, programs of vocational evaluation in an-^ 
attempt to cope with students or clients that had been previously screened out j6£ their 
service program. Vocational high schools and technical educational centers hav4 re- 
ceived the mandate to 'serve the occupational needs of handicapped individuals, dis- ^ 
advantaged persons, and those individuals wl^o werej deprived of the opportunity ob 
participate in technically-oriented programs. Cooperative agreements between puplic 
schools and state vocational rehabilitation agencies have established vocational 
evaluation in specia^ educational settings. Evaluatprs, in these settings, are charged 
with determining a psychological-educational-vocational diagnosis and^recommending a 
long-range program of services. " • i • 



10, Recent emphasis on correctional rehabilitation necessitated the advent of vocational 
evaluation to institutional and community setting, involved in rehabilitation erforts 
with the public offender. In these settings, .the evaluator must be willing to 'adapt 

and change to accurately assess a population of relatively young juvenile delinquents 
and adult offenders with antisocial behavior and authority problems. Successful 
evaluation efforts are initiated while the client is incarce;cated ^ and utilize work 
release and realistic job tryouts' when this is possible. * 

11. Manpower programs, such as WIN atid NYC, have realized the importance of pro- 
viding vocational evaluation services to many of their disadvantaged clients, priag: ' ♦ 
to implementing vocational placement or training* Social welfare programs are be- ^ 
coming also interested in involving vocational evaluation, to a "^g^reaber degree, with 

% ' \ ^ * 
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AFDC recipients in order to determine -self-support potential aiid realistic planning fior ^ 
training and/or ^mploymeixt. 'This expans*ion, in the need for evaluation, will be a 
severe test for the existing rehabilitation settings, providing vocational-devaluation , 
services. , * ^ * • ^ 

12. A recent sjCudy by Nadolsky (1971>) explored t}ae nature of vocational evaluation 
programs, for'^the disadvantaged, external. to traditional rehabilitation settings. 
The majotity of thesd facilities maintained formal or structured program^s of vocational 
^valuation.^ ^bout half of 'these settings indicated the 'major objectives of their vo- 
cational evaluation process,^ included, determining employability potential and establish 
appropriate vocational objectives ^f or their clients. Most of. the remaining facili- 
'ties specified major objectives, such as: involving an assessment of aptitudes, abillt ' 
worker traits, and work behavior of each, client; a process designed to relate findings 
orient clients to .specif ic- occupational Requirements was also an 'objective. 

' * • » ' # 

13r ^ Vocational evaluation also takes place, in settings concerned with ind:^/lduals who 
are unlikely to be remuneratively employed in competitive employement. Evaiuat^ion^ ^ - 
serves the purpose of recommending activity programs designed fc^t constructive and^ 
mean^ng^ful livi^ig.' These evaluation efforts are being directed toward a population 
of older, disabled persons, the very severely handicapped, and others. The evaluation 
objectives for these individuals center around sheltered employment, service groups, 
, volunteer services, community programs, and leisure activities.' 
»% . * • 

14. Many other types of settings that have incorporated vocational evaluation into 
their programs could al^o be discussed at this point. However, most' of* them have some 
of the same characteristics, objectives, and problems as tho&e that have, been pre- 
viously discussed ii\ t^is section. ^ - 

' 1 ' 

Questions for .Consideration by the Forum / * 

^ ■ ^ - / - . 

15. What should be the scope of vocational eyaluation in various settings? Should 
it be confined to vocational potential? To what extent should the vocati9nal evalua- 
tion a^^s the psycho-social aspects of the indiyfdual? Should the specific setting, 
by its nature or services and cli^ts,* determine the scope of vocational evaluation? 



16> mth the increasing variety of settings providing vocatidnal evaluation, how can 
evaluatora communicate with each other concerning goals, objectives, techniques, ap- ^ 
proaches, i?id process? Iif what ways could manpower ,^ rehabilitation, education, and • 
social welfare agencies contribute to a body of knoxizledge in vocational Evaluation? 
How can vocational evaluation attain a unified, professional direction with so many 
different settings involved? ' 

7. Recently, vocational evaluation units have been created numerous settings 
without regard to the training and experience. #f the individual selected as the eval- 
uator. , In what ways can this policy contribute to the inconsistency in the e'ffectij^e- 
ness and quality of evaluation pr<5grams? ' ' ' * ' . , . . ^ ^-^ 

18. What type of training is needed" by new or inexperienced evaluators that would 
assist them in providing Vocational evaluation services in' a variety of settings? 
How can in service traij;iing involving evaluatorp, from vai;ious settings, advance ^he ^ 
nrofessional 'Status of the vocational evaluator?. What^are the pros and cons t£ 
certifying, in some manner, vocatlpnal evaluators that work in various settings? 
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19. Explore the basic differences between formal an^ informal programs of vocational . 
evaluation; Which type^f settings have formal programs of vocational evaluation? ' 
'WhiQh ones* hojSe informal programs? Compare formal and informal programs in terms 
of advantages and disadvantages from the clients* point of view? ' 

t , . , 

^20. Regardless of the letting providing vocational evaluation, its "Relationship with 
the referral sources and/or funding agency determines the natur.e of /the program and 
the identity of the evaluator'. To wha,t types of settings would this statement apply^ 
and not apply, at the present tin^e? How are goals, in the settings previously dis- 
cussed, of vocational evaluation units related to the total setting (rehabilitation 
facility, institution, vocational training school, etc.')? , . 

21. Consider the need for vocational Evaluation in various settings concerned 
developing hum^n potential. What types of individuals, who do not^ nortoally r 
vocational evaluation, ar6 in need of this service? How can a program of vc^ 
evaluation be 1>est implemented in these settings? 

22. At the present time, various settings claim to provide a comprehensive program of 
vocational evaluation services. Can one :(^ehabilitation, education, etc. setting 
provide all the components of a comprehensive program of vocational evaluation? Dis- 
cuss the feasibility of having such a coaprehensive program without some type of simu- 
lated or "real" work environment. What are the essential components *of a comprehensive 
vocational evaluation program? 

\ " Challenge to the Forum 

23. A challenge is being issued to this forum_to explore and gain^ sope^ ^perspective _ 
to the milieu in which vpcational evaluation takes place. This paper has .been written 
in an effo|rt to stimulate thinking abot^t vocational evaluation from an expanded view- 
point of mkny different settings and, also, discussion of issues concerned with the 
vocajztbn^ evaluation process in various settings. 

24. Be creative in making conclusions, sugg^tions, proposals, 'and recommendations. 
Obtain additional information concerning various settings providing vocational evalu- , 
ation sejy^es^ Ffhd out who others are in these settings, who are functioning as 
evaluator 8, in ord'er to gain a better perspective of their roles, identity, and concept 
of evaluation. This resource paper is not intended to be all inclusive; treat it as 

a^ starting point for your forum discussions. 

« 

HORACE W. SAWYER 
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!♦ Vocational evaluation programs were established primarily for the purpose of 
expediting the delivery of rehabilitation services to handicapped clients • With 
the growth and increased demand for this service, the functions of counselors, 
psychologists, physicians, and other personnel , were altered to a significant 
degree, but most important, vocational evaluators became a rehabilitation pro- 
fession. As vocational evaluation developed, many attempts were made to delin- 
eate the responsibilities of the individual evaluation team members; however, 
fe^ efforts were directed to Refining the role bf the client, or his r^ht 
to participate in his own* evaluation program.' 

2. Few service area^ have greater impact on rehabilitation clients than does Vo- 
cational evalxiation simie future ^pervices often' depend to a large extent upon 
the results of psychological, medical, social, and vocational assessment. Never- 
theless,^ all too many cases, services are dispensed without regard for the 
feelings of the client* The client aUd his needs- should be the primary concern 
of evaluation persoifael, especially if the primary objec^tive of vocational eval- 
uation is to serve handicapped individuals. Therefore ^ the client *s needs, as 
far as possible, should 'take precedence ^ver those of agencies, facilities, 

and counselors. Simply sta{>TC, the client must play a signifl^t part in the 
total as^seVsment process, if vocation:al evaluation is to be felfevasi^and^ effective. 

3. The particular subject "Client Participation in Evaluation" is sure -to create 
some disagreement among evaluation personnel. Although all professionals are 
verbally committed to the client^as an active member of the evaluation team, there 
is little evidence that this is carried out in actual pracitce. It seems that 
the client receives services that are determined by professionals, rather than the 
services he feels will best meet his* individual needs. - - 

4. Much has be^n written and said about client p^^rticipatiori in evaluation. Al- 
though all presentations seem to emphasize a client-centered approach, the 
reality of this in actual pracTtice is subject to question. .Undoubtedly, the set- 

' ting of the unit, staff, and resources available influence the role of the client 
and the ultimate vocartional decision. Small workshops with limited resources and 
staff, ty necessity, will greatly restrict the extent of client participation, 
whila comprehensive, well-staffed facilities with unlimited resources should en- 
hance a more active client role. . 

5^. reality^ how much self-dire.ctfon the client will assume depends upon the ' 
qualifications and security the staff. A strong, confident, and secure staff 
will not^determine the client's service needs in isolation, biit will include him 
as -a contributing member of 'the total evaluation team throughout the evalx;ation 
process .( In this approach, the client is not viewed as an object to be manipulateds^ 
but as an individual* deservfiag of dignity and respect. In othep words, the compe- 
tent vocational evalxiatot will -create an atmosphere pf warmth and acceptance, 
which will. encourage client growth and self -direct ions i 

6. A rather comprehensive review of existing literature, accompanied by personal 
observations and cjmtact with vocational evaluators, supports the tact that 
active clieat Involveihent in the process enhances rehabilitsftion outcome. 
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Heverthelej^s, active client participation raises several pertinents questions • 
To what degree should the client provide directions for his own program? Does 
he provide Information in reference to. his needs and how these needs can be met? 
Is a client somewhat free to i^ect^the evaluation p^rogram that he feels will best 
meet one's needs? What voice should one have in the final recommendations for future 
services? Seemingly y all concerned agree that the client is a valuable resource 
In evaluation, nevertheless; the Individual may be the most neglected Ingredient 
In the assessment process. - ; , • 

7. Since vocaticfial evaluators assess the client's rehabilitation potential; and 
make, recommendations to the counselor for a job or vocational training program 
consistant with the evaluation results, th^ir responsibility to the client isi^ 
staggering. However, many vocational evaluators establish a paradigm of 
counseling^ the client Into a vocational area completely opposite to his real 
Interest (an example, accounting rather than mechanics) . In retrospect, such 
actions appear directed toward the needs of the evaluator rather than the client. * 
Moreover, thfe evaluator developed hypotheses for the client and concluded his 
program by making the final vocational decision. Perhaps, more involvement and 
better assessment of the client's needs and Interest would have prevented this 
type of situation from* occurring. 

8. In addition to the factors previously mentioned, the extent the client can 
participate or direct his own program depends upon intellectual ability, emotional 
stability, mobility. Insight, and degree of freedom granted by vocational eval- 
uatoi;;a^. Basically, hqwever. If vocational evaluation is to attain its objective, 
and effectively serve the client, then this individual must be' deeply involved; 
nevertheless, considerations must be given to air restrf.ctive or limiting aspects. 
All of this is to say, if e^luation is to succeed-, the process must be observed 
from an internal frame of *ref erence, the client,, and an external frame of reference, 
the vocational evaluator and/or other evaluation personnel. 

9. From a personal viewpoint, it appears that the clients are evalxiated for training 
areas or jobs that exist in the facility or the local community. Therefore, voca- 
tional evaluation is not as comprehensive a:s is often laplied. This, in itself, re- 
stricts client participation. Further suggested is that the client may have little 
voiqe in tihe selection of evaluation units and complied with the decision of the 
referring^ counselor rather than , be denied needed services. All too many clients 
that are admitted for vocational evaluation are under the Impression they are 
enrolling for a definite training program. Needless to say^ these clients are not 
prepared to assume responsibility for their evaltiation pro-am. 

10. Based on personal experience it seems that tjie rehabilitation client's parti-t 
cipation his own evaluation program is minimal. Nevertheless, several factors 
come to mind that' could enhance client acceptance S^f greater responsibility f oif 
vocational assessment^ These include: Better planning and orientation on the part 
of the referring counselor; cqreful selection of evalu^ion xinit'; more attention 
to the client's expressed 'interest ; an in-depth orientation to the evalxiation 
process; and conducting a broad and coifiprehensive program to expose the client 
to an Increased number of vocational areas* 

11. Much of the topic, "Client Participation in Evaluation,"^ is subjective and ab- 
stract which mikes *it difficult to discuss in concrete terms. Ideally, the client's ^ 
role could be described much as the vocational evaltiator, ^couns^lor, or psycho- 
logist, but unfortunately there are too many variables that Influence participation. 
On i^aper, all presentations emphasize client participation and responsibility, as 
weUL as encouraging consideration of the client as a contributing member of the 

^ w . . 
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evaluation team; however, theory and practice are far apart on the evaluation conr 
tlnuum. 

12. As stated previously, the client, the person most directly concerned with the 
outcome of evaluation, is oSten overlooked or neglected by prof e^ssionals in planning 
delivery of rehabilitation services. If vocational evaluation is to be valid, the^ 
•client must accurately feel that he is an important member of the evaluation, team, 
in a few* instances, it has been recommended that the client serve as co-manager of 
his own case, as far as his abilities and limitations permit. It^would be difficult 
to ,take issue with this suggestion since the way the client views his future is 

the primary' variable in any rehabilitation program. Theory and practice again^ 
however, appear to be two different matters. 

13. Regardless of how realistic the vocational evaluation is made to appear, the 
client still sees himself as client and not as a productive worker. 'In this rol6, 
the client e^eriences a considerable amount of anxiety* as all people do when they 
are subjected to any t3rpe of evaluation by other indiv|diials* In addition, as eval- 
iiatioji findings are uncovered, the client is seldom i^ormed of his performance, and 
has little idea of the direction his program is tajrf&g. In the evaluation proCBss ' 
there seems to be few provisions for the client tfc utilize tlie evaluation results to 
formulate his own decisions. 

14. Summarizing the theories and their relationships to actual practices in reference 
to the client's role in vocational evaluation, there is strong evidence that a 

wide chasm ^exists between the ^ two. Nevertheless, theory and practice can be brought 
closer together with a great deal of work on the part of this project *s partici- 
pants. J ^ 

15. Provided vocational evaluation is to be a meaningful service program, the roles 
of the personnel must' be delineated, methods and techniques defined, knd'tealistic 
goals and objectives established for the ^unit.. Finally, the role the client will 
play as the recipient of services must be" clarified with little room for misunder- ' 
standing. Needless- to say, this applies equally to the referring counselor and 

the evaluation staffs The very nature of the rehabilitation process demands that 
defining, the Qlient*s role begins with the referring counselor. Therefore, the 
questions are: What, are the counselor's responsibilities? What is the function 
of the client? What should be the process of selecting an evaluation 'unit? 

16. Whe;> service needs have been identified, and a plan for service delivery form- 
ulated, an evaluatiQn unit must be s^lect^d to the mutual satisfaction of both cll^t 
and counselor. The questions developed here are:. What role doei eacf^play in'de-^ 
veloping a meaningful program? How can the client maintain some control or directioi* 
for his own evaluation program? Should hypotheses be developed at this point in time 
in refeirence to work or trailing? 

17. During the Voc^ional evaluation program, there are many instances that active 
.client participation can be encouraged. Specific questions for consideration are: ^ 
^What factors enhance, or restrict, the client's role? What degree of responsibility 

should the client have in directing his case and in the selection of evaluation 
tests for specific vocational areas? Should the client view the test results^ 
including psychoiogicals, as they are recorded? Should the client participate in case 
conferences that relate to, his own evaluation program? 
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18. At the conclusion of vocational evalxiation, many sittiations arise and pose 
pertinent questions fo;r consideration by vocational evaluation personnel, namely: 
What about the client reading the final evaluation report;? alternatives should 

the client have (not the one he has)*'if he disagrees with thJSeport, evaluator/ 
counselor interpretations? Who should plan and formulate reWbilitation services 
after evaluatiofi, the client, the evaluator, the counselor or dll. personnel 
involved? A final question. What can be done to ^.ncrease clipnt responsibility 
or what role can the client actually play in the vocational evaluation process? 

J. ' ' » , 

194 For numerous reasons,' rehabilitation has changed, ^an^i,. as a result, vocational" 
evaluation^must change in o^der to keep pace. Today, it is not known -for certain 
whether or^iot the various techniques utilized in the 'evaluation process are the 
most appropriate to adequately evaluate handicapped individuals^ -In recent years, 
services have be^en extendi to clients previously ineligible. Moreover, it is 
without question that additional disadvantaged and severely disabled clientele will 

' qualify for services. in the near future. The chall-erfge to the field is complex ~ 
what can be done to insure better client participation? ^In order to accomplish tljis 
objective, what changes would need* to be made in the evaluation process, in 
techniqu^s^ in personnel', in psychological assessment, in st:affings, and the 

. functions of present evaluation staff? 

20. Perhaps this very \omp Heated topic can be^ made less 4ifficult by reviewing 
the general evaluation^rocess, and the role_the present client plays at various 
intervals. Each vocational evaluation unit should develop a plan of action that 
will have a definite impdct on counselors and evaluation staff , but even more 
important,, one tha^'wlll emphasize greater client part icipat ion • 

^ir \ ■ . ' 

^ . ^ B. DOUGLAS RICE>- 
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The'validity and use of vocational evaluatiop findings have been a subject of 
controversy among rehabilitation and oth^r professional vorkers for several years, 
Pepending on your particular definition of vocational valuation, its validity depends 
on the aspects it purports to discover. According to Rice (1972), vocational evaluators 
should diagnose vocational p'roblens and then prescribe procedures, methods, and pro- 
grams that will remedy or alleviate, these deficiencies. Many others include determin- 
ing* rehabilitation potential, particularly work potential, as a major objective. Yet, 
this v^\ry^ Important function is being performed i3 innumerable vays and -by variously 
qualif ieTllndividuals, ^ 

2, Suazo (1965) described evaluation as th^ key to rehabilitation. ' However, Nadolsky 
(l97l) reported it questionable* Whether a syst^atic body of knowledge exists for the 
field of vocational evaluation. If this is true, then it is extremely important , for 
vocational evaluation programs to demonstrate their eflicacy if they are to warrant 
usage hy rehabilitation and other agencies, 

3, In order for a profession to establish itself, ther§ must be a systemat'ic body 

of knowledge suj)ported by meaningful , research. Howler, as Clark (1969) repOr4:ed, there 
is an appalling lack of supportiv4 research, Spergel (1970) believes that voca4:ional 
evaluators have rationalized against studying vocational evaluation outcome and. those 
studies that have been done 'are poorly designed. Overs (1970) has also found little 
research reported in sci!entif£c journals, and advocates a publication that will bring 
together ^research findings, ^ Host likely, many rehabilitation, agencies and facilities 
haye done self -studies* of their vocational evaluati^on programs, byt have reported their 
results in obscure project report's or unreleased documeni«, , 
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4, * There have.b^en? several studies on 'the utility of ,^^ob* sample t^sks, psychological* 
tests, and evaluator ratings of clients. Overs (1970) |ias done a commendable jofc in 
summarizing these f±nding^. He also reviewed research pn tot^l assessment scales, whicji 
purport tQ predict success in training, in placement, a^d in ^ployment . ^ There, has * 
been' only one comprehensive assessment of the vocational evaJLuation process, Jewish 
and VocratioYial Employment Service of Philadelphia (1968) completed an ambit'jLOiui..pxoject 
t^o measure the 'efficacy of^j^helr vocational evaluation program. Using Doth es^eri*- 

,mental and cdntro^l groups, it was%found th^t clients who participated in work evaluation, 
^prior to emplo^ent counseling and placement > ha^ a better vocational outbome, and ^ 
"counselors ahd clieots i^ere favorable toward this program*^ * , ♦ • 

* • 

5, There haye been "^xumerous studies on vocational outcome, of Success of rehabilitation 
programs, Ne^^- (196'0) studies^the succfess of the Chicago J,V.S, program and found the 
predictic&r^^f %he staff regarding placea&J^ity and ^ployability werengs^sr^lly upheld, 
and that the f^ily was important in the client's vocational adjustment, Phelps (1965) 
evaluated' the program at the West Virginia Rehabilitation Center and found that 85% of 
50 DVR counselors surveyed found the^r mentally .retarded clients, who were evaluated 
at the Center, easier to Work with £han Other mentally' retarded clients In their' case- 
load, ^Campbell & O'Toole (1970) obtained the reactior^ of 238 former clients'at 
Cleveland's Vocational Guidance*and Rehabilitation Services who' had been, judged unemploy- 
ablet^nd untrainable by conventional rehabilitation methods before entering the program. 
When asked what they thought of the work ad^ustm^nt program,' 24% indicated ^'excellent," 
47% "somewhat, helpful,'' 15% "neutral," 12% "\>aste of time," and 2% "detrimental." 

6, ,The Importance of -the family,' agenpy, and other variab^s in validating vocational 
evaluation findings was pointed out by Brolin & Wright (19?1) who studied the extent to 
which five type^ of recommendations from ap. evaluation f enter for the retarded were , 
implemented and variables related to thcfr Implementation* It was found that only 60% 
of the vocational recommendations .were /'definitely" followed, and that many other important 
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rehabilitation reconmendations either were only partially followed, or were not followed 
at all for a large number of mentally retarded clients. Different parttern§ of variables 
vere found to Influence the five typtfs of recommendations made (I.e., social, medical, 
psychological/ educational, and vocational). The influence of the family on'the imple- 
meflatlon of all t3rpes of recommendations was an important finding. A further stu3y on 
the samfe clients ^Brolin, 1972) found client oUto^me to be particularly related to the 
Interactlofi of certain client, family, community, and agency variables. It was also 
found that a large number (1/3) of qlient,^ received Inadequate services after evaluation 
and, of tho^e receiving adequate services, about 1/3 of the males and almost 1/2 of the 
females failed to ^teach their assessed vocational outcome potential. ^ 

7. Thejre are several other problems that have precluded assessing the validity of 
vo^cational evaluatjlon programs. One of these, has been' the inability to gain universal 
agreement about what constitutes vocational evaluation, and how it should be done. This 
is unfortunate because if we are to develop a systematic body of knowledge on the sub- 
jec-t, train people to be evaluators, design vocational evaluation programs, and Xhen 
determine the validity of their efforts, we had better have some agreement on what it 

is we are suppose3 to be doing. - ' - " , . 

8. This 'confusion Is apparent when^one observes the interaction between state reha- 
biliation agency and rehabilitttlon facility personnel. In, many instances, rehabili- 
tation counselors are very "upt^ight" about facility programs, including the evaluation 
aspect. Often they fjel the evaluation is very limited, unsophisticated, and too 
costly. They complain about insufficient reports and other comr^ications of client 
progress and potential. They feel that clients are ofte^n left in the programs too long 
just to get the referring agency's money (Brolin, 1973). 

9. There are wide degrees of variance in vocational evaluation philosophy and 
te^ihnique ,3iaong programs. Some have very constricted , definitions and programs, whereaa _ 
others are quite encompassing. But one thing that is almost always missing is any 
systematic assessment of what they.*do. Another phenomen^P that occurs is the lack 

of knowledge rehabilitation counselors and other referring personnel, have about 
vocational evaluation and other aspects of facilities. One other problem is the lack 
of client knowledge and involvement in decisions about one^s own program. It appears, 
however, that in the very near future this phonomenon will cease and the rights of 
clients will be one of the greatest concerns "we will attend to in rehabilitation, 

10. Up to this point, referring caseworkers have had to. place their confidence in the 
vocational* evalu4tion program. However, in many.^^ in stances they. found reason to question 
what they were getting^ for their money. Often rei^mmendations from evaluation programs 
were very^ general in riature and of little value. R^dolsky (1971) sheds some light on 
-»this from his study as he concluded that vocational evaluators appear to "use and 
attach mote value to techniques and procedures which provide a general understanding 

of a client^s vocational assets and limitations, rather than those designed to uncover 
specific vocational abilities and deficiencies (p. 23)." He also found little follow- 
up activity on their patt.. It is no wonder counselors are confused about vocational 
evaluation programs. With the misunderstanding of what the evaluation can do, with 
the different philosophies and techniques, with little client involvement and followr 
up, and the like, it is no- wonder the current confusion and concerns exist. 

11. A Scientific approach is needed _lf vocational palliation ds going to have any 
degree of validity. As noted by Kerlinger (1967), *"The scientific approach has one 
characte^stlc that no other method of attaining knowledge has: self-correction. 
There arf^ built in checks all along the way to scientific knowledge (p. 7)." In a 
fine artAzle, Walker (1970) warned vocational evaluation to take heed now and avoid 
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the pitfal^ of many other related disciplines that he says have now become irrelevant 
because they fail to develop a feedback system which narrows the gap between what they 
are and what they ought to be (p. 39)," 

12. Pruitt (1970y has made a fine attempt to develop a set of theoretical constructs 
by listing basic assumptions* that he feels underlie work sample theory. This is one of 
the few atrempts to do anything of this kind. Perhaps one reason for this is the 
negative connotation accorded theory by many rehabilitation personnel who pr'ofess 
allegiance to a Tpractical" armamentarium of tests, irork samples, and real work. Thus, 
the ^ evaluator approaches his job in an a priori way, i.e., assuming that what he is 
doing is reasonable and pelf-evident • However, the question can be posed as "According 
to whose reason?" Two evaluators, using supposedly rational processes, can reach differ- 
ent conclusions about a client, and they often dot 

13. Besides Pruitt,, there have been very few attempts in vocational evaluation to set 
forth a "set of interrelated constructs (concepts), definitions, and propositions that 
present a systematic view of phenomenon "by specifying relations among variables, with* 
the purpose of explaining and predicting the phenomenon" as theory is defined by Kerlinger 
(p. 11). Nadolsky (1966, 1971) has given some-attention to this area but the most com- 
prehensive approach is. the work done at the University of Minnesota by Dawis, Lofquist, 
and Weiss (1968) in developing and refining (their Theory of Work Adjustment . The 
Minnesota Theory has attempted to meet the criteria set forth by Kerlinger. Although 
essentially a placement theory, it is also quite applicable to the study and operation 

of vocational evaluation programs (Brolin, 1973) and Browning, 1972), The model is" too 
complicated to be reported here, and it is recommended that Qawis" (1967) article be 
rea4 and/or "copies of their monographs be obtained. The model focuses on the individual 
and his environment, with work adjustment dependent upon both sat isf actor iness (ability 
to do the job satisfactorily), and satisfaction (client satisfaciton with the job). A 
number of instruments have been developed to measure aspects of client personality and 
the work environment. This theoretical meodel has much to of ter vocational evaluation. 

* CONCLUSION . . . 

14. The assessment of the validity of any vocational evaluation is contingent upon 
many assumptions. First, we assume the vocational evaluation program has competently 
trained personnel. Second, we assmne that they have clearly specified the objectives 
of their program^ have the proper components to do vocational evaluaMon, and are able 
to measure whether or not they have sufficiently met their objectives. Third, we assume 
the client has been sufficiently cooperative and motivated to display his vocational 
abilities and ne^ds. Fourth, we assume that the persons who have rendered* treatment 
(e.g., work adjustment, training, counseling, etc.) and job placement have performed 
those aspects competently. Fifth, we 'assume that the job the client is placed on has 
sufficiently met his basic needs and is something the person can do. And sixth, we > 
assume that the client in able to mange his other activities-of-daily living and has 
the support of someone, like- a f^mily^ during crisis periods. 

15. Since the ultimate criterion of successful vocational evaluation, i.e., the con- 
gruence ietween predicted and actual client outcome, is sq dependent on a multitude of 
factors beyond the evaluator's control, a more liranedi^te assessment of its value appears 
warranted. The resylts of a vocational evaluation could be assessed Immediately upon 
its completion by/masking the opinions of counselors and other referring caseworkers, 
those who are to parry out the recommendations, and the client and his family, about 
their satisfaction with the program. Some examples of questions include: i^) Do you , 
feel the recommendations ^re clear, specific enough, and realistic, and (b) Can the 
rec9!nlfiendations be implemented? ^An>f questions answered "No" should be explained. The^ 
InvolVeinent of the client in, evaluation planning should be ascertained. 
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16. The next point in assessing the validity of the vocational evaluation is during 
the treatment-training phase, either during and/or after its completion. At this 
point, questions can be posed of the training staff as to the correspondence between 
their findings and those of the evaluators in regard to client strengths, weaknesses, 
interests, and vocational training potentials. The realism of the recommendations can 
be evaluated furtlier at this t^e. Client satisfaction of the congruence of the evalu- 
ation with the training prbgratt? shqul^.. be determined. After placement (or whatever 
happens, next), periodic follo|7-up witli' client, family, and employer should be done to 
again. ascertain how well the evaluation was able to be of assistance. This includes 
the extent to which other discipldlnes and agencies contributed toward carrying through 
the needed services. 

17. The question of 'what really constitutes a good vocational evaluation is not an 
easy^ one. If we wait too long after an evaluation, tao many extraneous variables and 
forgetting will operate to confound such an analysis. -Thus, Immediately following 
and periodic evaluations of the evaluation mu^t be employed with the latter ones bein^ 
less valid as time increases. It is questionable if vocational evaluators can really \ 
predict, with any degree of accuracy, most clients* future vocational potentials. We ' 
must come to the realization that thexe are so many influences on what one becomes, 
that our most important role is for short-range planfaing and re-evaluation as the 
clients develop new skills and horizons. Evaluators should t^e-enter the scene at 
many different points along the rehabilitation process rather than just at th,e be- 
ginning. 

18. In summary,' completely valid vocational assessment and prediction is extremely 
difficult./ It consists of both short-term and long-t,erm goals, the latter (what can 
he do in the future) being most difficult to ascertain. Vocational evaluation consists 
of both quantitative and clinical judgements. Besides the* client, however, vocational 
outcome also highly dependent on the interaction of many family, community, and 
agency variables. Neff (1970) has called attention to "the fact that human behavior 

is not only a function' of yie characteristics of persons,^ but also a function of the 
situations in which persons find themselves (p. 28).'* It is time, tfieref ore, for 
evaluators, work adjusters, placement specialists> counselors, administrators, educators., 
the clients, and their families to begip working more closely together , so that client 
needs can b^ most adequately met./ «• 

19. We ar^ entering into an era of accountability. Guidelines have been established 
for working i;elationships between vocational rehabilitation agencies ^d rehabilitation 
facilities. Accreditation is now being mandated and program evaluation greatly encouraged 
to insure a ceVtain level of standards. Vocational ei^aluation is at «a crucial stage in 
its development. Vocational evaluation personnel must meet this challenge by developing 
the njetS^ddlogy wljereby their program's efficacy can be systeihatically and empirically 

rlidated. 

*DONN BROLIN 
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